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Preface 



This book is the result of an extraordinary, long-term partnership be- 
tween states and localities seeking to reform welfare and researchers 
attempting to assess the effectiveness of their efforts. In the late 1960s, 
Congress began to reshape Aid to Families with Dependent Children - 
the nation's largest cash welfare program - to encourage employment 

among the heads of families receiving welfare, most of whom were single 
mothers. As these initiatives got under way, starting in the mid-1970s, 
researchers at the Manpower Demonstration Research Corporation 
(MDRC) and other organizations, building on the approach successfully 
used in the earlier negative income tax experiments, began applying the 
tools of classical, random assignment field experiments to the key policy 
questions about these initiatives. Would they work? Could they reduce 
the welfare rolls? Would they cost or save money? Would they cause 
people to get good jobs and move out of poverty? This book summarizes 
and interprets research findings that help answer these questions. It thus 
provides a knowledge base for states as they make the critical choices 
that will turn the current welfare reforms, the Family Support Act of 198«, 
into a reality during the 1990s. 

While this book was being written, the importance of this knowledge 
base came into sharper focus. The 198« legislation offers states $1 billion 
a year in new federal money for welfare-to-work programs, but only if 
they put up matching state resources. States will be making these fund- 
ing decisions in unusually harsh fiscal conditions, with many facing 
budget deficits and powerful competing claims on scarce funds. In such 
a climate, the reliable lecord of information on v/hat works best for 
whom takes on added importance. 

The legacy of the rigorous studies that have been completed, invol"- 
ing more than 65,000 people in scores of communities in 21 states, 
provides convincing evidence that, in many ways, these programs suc- 
ceeded. Overall, they increased the earninj;s of poor famili-v; .^nd saved 
money. Howeve*-, they did not eliminate welfare or poverty. The chal- 
lenge for the 1990s is to make such programs work better and to deter- 
mine whether greater investments in education and training will pay off 
in higher skills and better jobs, in reducing long-term dependency, in 
strengthening families, and in improving outcom.es for children. 



FRir 



IX 



X 



PREFACE 



The authors - MDRC's President and Senior Research Associate in 
education, respectively - had three main audiences in mind in writing 
this book: the state and local people on the firing line who fund, design, 
and implement the new reforms; the wider policy and academic commu- 
nity, which will shape public expectations for reform; and the U.S. 
Department of Health and Human Services (HHS), which will play a 
critical role in determining the agenda for future research, including the 
majorevaluationof thenew law that theauthorsand other staff at MDRC 
are conducting. 

This volume reflects the work of many people. None of the informa- 
tion presented here could have been acquired without the active in- 
volvement of state administrators who put their programs under a 
magnifying glass, and the willingness of the staff in state and local 
agencies, in the midst of their harried work, to cooperate with the 
requirements of the research. We, and the community of practitioners 
and scholars committed to informed social policy, owe much lo these 
individuals, only some of whom can be listed here. Among the admin- 
istrators and staff who were involved in MDRC's completed 
welfare-to-work evaluations aro: Rowena Bopp, John burdette, Gregory 
Coler, Jerry Evans, LeonGinsberg,ThomasGunnoe, KalmanHettleman, 
Richard Jacobsen, Ray Koenig, Larry Lockhart, William Lukhard, Ruth 
Massinga, Ronald McAtee, Linda McMahon, George Merrill, Jeffrey 
Miller, Douglas Patino, Walt Patterson, Michael Petit, Marion Pines, 
Frederick Pond, John Robbins, Ray Scott, Diana Scully, David Siegel, 
Sybil Stokes, and Linda Wilcox. 

The book's greatest debt is to the staff at MDRC. While this volume 
summari2:es the results from a substantial body of studies, those that 
form its core are the evaluations that made up MDRC's Demonstration 
of State Work/Welfare Initiatives, a multi-state field research project 
conducted between 1982 and 1988. The success of this undertaking 
depended on the entire study team: the many people who spent years 
designing the study, put'ing it in place, carefully collecting and process- 
ing the data, conducting the analysis, and reporting on the results. The 
Work/ Welfare Demonstration was intensely collaborative, making this 
book a collective effort in the strongest sense of that phrase. 

The staff working on this demonstration included economists and 
other social scientists, people with operational! backgrounds, former 
welfare administrators, systems designers, and data analysts, with the 
senior author directing the research. The design and overall effort 
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xi 



benefited from vigorous intellectual debate in which different perspec- 
tives and analytic styles merged and shaped the final products. Several 
people made critical contributions to that project and thus this book. 
Robert Ivry and Michael Bangser guided MDRC's work with the states 
and assisted in distilling the research findings. Barbara Goldman man- 
aged the research effort, was responsible for the study of participation, 
and contributed to all aspects of the project. Daniel Fried lander took the 
lead in the study of program impacts, David Long in estimating benefits 
and costs, and Karen Paget in overseeing the rammoth data collection 
effort. William J. Grinker, as president of MDRC when the project was 
conceived, helped shape its initial vision. Barbara Blum, who headed 
MDRC through moct of the years of this project, bro\<ght a calm and sure 
hand to the implementation of a unique partnership in learning. Other 
staff who were instrumental to the success of this project were the late 
Joseph Ball, Gayle Hamilton, Darlene Hasselbring, James Healy, and 
Janet Quint. Major contributions were also made by George Cave, 
Gregory Hoerz, Marilyn Price, James Riccio, and Kay Sherwood. 

Some of these people and others at MDRC also made a direct 
contribution to the preparation of this volume. Cameran Lougy had 
major responsibility for checking much of the detailed information in the 
book and made numerous substantive contributions. Daniel Fried lander 
both reviewed the manuscript and inspired some of the thinking that lies 
behind the book through his active collaboration with the senior author 
on a related project. Kay Sherwood contributed her insight on both the 
implementation of welfare reform and the details of the 1988 legislation 
in reviewing and critiquing the manuscript and responding to the many 
queries. Gayle Hamilton provided the authors with numerous sugges- 
tions and interpretations. Gordon Berlin, Robert Ivry, and John Wallace 
read many drafts and help >d us sharpen our view of the critical choices 
facing program administrators. David Long reviewed the interpretation 
of cost data and wrote a special appendix on program costs. Patricia 
Auspos contributed to the project in its early stages. 

This Preface began by acknowledging tvv^o partners: the states and 
the researchers. But the wherewithal to transform a mutual interest into 
actual knowledge came from thesupport of visionary funders. Through- 
out the last 17 years, the Ford Foundation stands out as the central force 
in creating the knowledge base that made this book possible. In 1974, the 
foundation initiated the National Supported Work Demonstration, which 
set a standard for future evaluations. In 1982, it provided the grant that 
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led to the Demonstration of State Work/Welfare Initiatives, and did so 
under a unique challenge grant structure that reflected both an extraor- 
dinary vote of confidence in MDRC and the participating states and the 
willingness to take a risk for the sake of an unusual opportunity to learn. 
At the foundation; Susan Berresford has been the consistent voice mak- 
ing this work possible, and Prudence Brown and Gordon Berlin (then at 
the Ford Foundation) provided intellectual guidance and the flexibility 
and vision vital to the successful implementation of a complex, multi- 
year effort. The Ford Foundation's Project on Social Welfare and the 
American Future and its Urban Poverty Program also provided the 
resources that allowed us to transform our manuscript from its initial 
version into this book. 

A major share of gratitude is also owed to many people at HHS. In 
late 1989, HHSa warded MDRC an eight-year contract to evaluate the Job 
Opportunities and Basic Skills Training (JOBS) Pmgram, the 
weltare-to-work program that is at the core of the 19H8 legislation. This 
book had its origin as a rep^)rt vritten in 1990 under this contract. (The 
Introduction provides a detailed picture of this relationship as well as the 
rationale for the book's coverage and an overview of its contents.) In 
preparing this volume, we beneflted directly from the review and 
assistance of people at HHS and also from the ongoing exchange that has 
shaped the agenda for the JOBS tvaluation and thus th- context for this 
book. Within the Office of the Assistant Secretary for Planning and 
Evaluation (ASPE), Canta Pian and Julie Strawn provided valued sup- 
port, and they and their colleagues Michael Fishman, William Prosser, 
andStevenSandellprovidedhelpfulcommentson an earlier draft. In the 
Family Support Administration (F^A) - now the Administration for 
Children and Families - we particularly beneflted from the counsel and 
critiques of.- everal drafts by I loward Rolston, who over the past 10 years 
has been an insightful and valued reviewer of MDRC's work. The 
authors also gratefully acknowledge the a.-isistance of the following other 
staff at FSA: Gary Ashcraft, Paul Bordes, Elizabeth Barnes, Nancye 
Campbell, Alan Yaffe, Penny Pendell, and Leonard Rubin. 

finduring thanks are due for the criticism, wisdom, and insights 
shared over the years by members of MDRC's Board of Directors and in 
particular its special Advisory Committee to the Demonstration of State 
Work/Welfare Initiatives. Chaired by Robert Solow, the committee 
included as its members Henry Aaron, Ciary Burtiess, David Fllwood, 
Frank Levy, Richard Nathan, Robert Reischauer, and Harold Richman. 
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Collectively and individually, the members of this committee inspired 
and shaped MDRCs urork and Ihe analysis that informs this book. 
Richard Nathan, Chairman of MDRCs Board and a member of this 
cc-iimittee, stands out for the special contribution he made to the 
launching of the Demonstration of State Work/Welfare Initiatives and 
to MDRCs direction and evolution during these years. The volume 
also reflects the input of several people v^hose close reading of the 
manuscript proved highly useful: Gary Burtless, Mark Greenberg, 
Robert Greenstein, Laurrence Mead, and Kathryn Porter. 

In preparing a volu me that summarizes the completed and in-progress 
work of so many authors and organizations, v^e relied on the assistance 
of a number of colleagues. Stephen Bell at Abt Associates deserves special 
mention for his unstinting cooperation in discussing Abt's studies and 
reviewing the manuscript. George Falco of the New York State Depart- 
ment of Social Services, Demetra Nightingale of the Urban Institute, and 
Denise Polit of Humanalysis contributed much time and many sugges- 
tions. John Burghardt and Stuart Kerachsky of Mathematica Policy 
Research also provided assistance. Kathleen Nazar of the Pennsylvania 
Department of Public Welfare, Chris Hamilton of Abt Associates, Ellen 
Seusy of the Ohio Department of Human Services, and many others 
helped obtain document*:. 

Judith Greissman edited the book, always improving on our u ork. 
We also thank Suzanne Wagner for her care in editing the tables. Produc- 
tion of the text and tables of the many drafts owes much to the skills of 
Patt Pontevolpe, Stephanie Cowell, and Claudette Edwards. We a 
indebted to Rowe & Ballantine for the final design. 

Finally, we thank the Russell Sage Foundation - and specifically Eric 
Wanner, the foundation's President, and Lisa Nachtigall, its Director of 
Publications - for its support and efforts as the book's pu jlisher. 

Judith M. Gueron 
Edward Pauly 
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From Welfare 
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Introduction 



In 1988, Congress passed welfare reform legislation - the Family Sup- 
port Act (FSA) - that affirmed an evolving vision of the responsibilities 
of parents and government for the well-being of poor adults and their 
dependent children. The new law left intact the basic entitlement nature 
of the Aid to Families with Dependent Children (AFDC) program, the 
nation's major federally funded cash wel fare program, and even expand- 
ed it by requiring states to extend coverage to certain two-parent fami- 
lies. But in addition it sought to shift the balance between permanent in- 
come maintenance and temporary support toward the latter. Thus, the 
anchoring principle of FSA is that parents - both fathers and mothers - 
should be the primary supporters of their children and that, for many 
people, public assistance should be coupled with encouragement, 
supports, and requirements to aid them in moving from welfare to 
self-support. While placing a responsibility on welfare recipients to take 
jobs and participate in employment services, it places a responsibility on 
government to provide the incentives and services to help welfare 
recipients find employment. For noncustodial parents (usually fathers), 
this is reflected in a renewed emphasis on child support collection. For 
custodial parents (usually mothers), this means new opportunities for 
publicly supported child care, education, training, and employment 
services, coupled with new obligations to take a job or cooperate with the 
program. 

The centerpiece of FSA is the Job Opportunities and Basic Skills 
Training (JOBS) Program, the vehicle for increasing poor families' 
self-sufficiency. JOBS provides new federal matching funds for state 
welfare-to-work initiatives but does not specify thoir H^^^ipji Mislead, it 
identifies a se*. of targeting and participation goals and a choice of service 
methods for achieving them and leaves it up to the states to transform 
these into a concrete program. JOBS' complex performance require- 
ments offer states incentives and opportunities. At the same time, states 
face unfolding choices arising from the requirement th?t JOBS be 
implemented by October 1990 and the pressure to meet increasing 
performance goals through 1995. 



1 



2 



FROM WELFARE TO WORK 



Because JOBS, while building on earlier policies, represents an im- 
portant new initiative, the legislation calls foran evaluation to determine 
the effectiveness of different approaches to assisting welfare recipients. 
The U.S. Department of Health and Human Services (HHS) contracted 
with the Manpower Demonstration Research Corporation (MDRC) to 
conducta major, eight-yearevaluation of the JOBS program. In consider- 
ing its options for conducting this evaluation, HHS recognized the 
importance of the context in which JOBS would be implemented. First, 
while the extensive recent research on JOBS' predecessors - the Work 
Incentive (WIN) and WIN Demonstration programs - provides an 
important base of knowledge, federal and state policymakers face great 
uncertainty about the likely payoff of different JOBS implementation 
strategies. Second, over the next five years, the JOBS program will be 
evolving and is likely to vary substantially across the country, as states 
phase out WIN and design new programs to reflect available resources 
and perceived needs. Some state JOBS programs are in early stages of 
development, while others are relatively mature because they essentially 
expand and continue pre-JOBS program activities. In this environment, 
guidance on improving and shaping programs will be timely and useful. 
Third, to get the maximum potential knowledge from the JOBS evalua- 
tion, it should be designed and conducted not in isolation but within 
the framework of the numerous complementary studies. 

As a result, HHS has requested that the JOBS evaluation be designed 
to build and expand upon two important bodies of knowledge: the 
recently completed large-scale studies of related programs operated 
during the 1980s, and the federal, state, and foundation-funded studies 
now under way that will be providing information during the period of 
the JOBS evaluation. It was hoped that with such a strategy the resour^js 
for the JOBS evaluation could be targeted to add new information to a 
growing knowledge base about the effectiveness of government 
employment and training services and mandates. 

i> meet this goal, MDRC was asked to produce a synthesis of what 
has been learned from past research on similar programs, what is likely 
to be learned from studies already funded, and what important gaps in 
knowledge will probably remain. This fit well with the charge contained 
in a joint grant MDRC had received from the Ford Foundation's Urban 
Poverty Program and its Project on Social Welfare and the American 
Future: to prepare a volume summarizing the lessons from selected 
welfare-to-work studies, including those conducted under MDRC's 
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Demonstration of State Work/Welfare Initiatives, a multi-state project 
funded through a challenge grant from the Foundation. With support 
from these two sources, at MDRC Judith Gueron (President) and 
Edward Pauly (Senior Research Associate) took on the task of writing 
this book, which also reflects the input and work of many of their 
colleagues. In preparing the volume, the authors sought to identify the 
primary research questions that should form the basis for the JOBS 
evaluation. But there was a broader goal as well: to inform administra- 
tors, policymakers, and the concerned public of what past studies 
suggest is and is not known about the trade-offs involved in the critical 
JOBS design choices. Decisions on JOBS are being made and will be 
rethought over the coming years, and the considerable research record 
can provide important guidance. 

This synthesis covers a specif ic domain of programs and services and 
addresses a particular group of questions. It summarizes what is known 
and will be learned from completed and currentstudies about the impact 
and cost-effectiveness of welfare-to-work programs and the different 
approaches used in these programs, in varied local contexts and for 
important groups of AFDC recipients. It reflects the existing state of 
knowledge about different program components (job search, work 
experience, training, and education), administrative strategies (case 
management, monitoring, and sanctioning), and support services (child 
care). It covers both what the authors call broad-coverage (mostly 
mandatory) programs and selective-voluntary (mostly smaller-scale, 
more expensive) programs. It discusses program effectiveness for differ- 
ent groups in the AFDC caseload, particularly long-term and potential 
long-term recipients and other AFIXT subgroups given prominence in 
the JOBS legislation. The synthesis focuses on program impacts, rather 
than operational feasibility or program implementation, although this 
further body of findings (including information on participation rates) is 
summarized briefly when it is directly relevant to the literature on 
impacts. 

In conducting this review, the authors placed primary emphasis on 
studies that used an experimental design. In these studies, people in the 
research sample are assigned to an experimental group (targeted for the 
welfare- to-work program) or a control group (not eligible for services 
provided through the program but eligible for all other employment and 
training services in the community, as well as for basic welfare benefits). 
Crucially, assignment is by a random process, resulting in the creation of 
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directly comparable research groups. The employment and welfare 
experiences of the two groups are then followed over time; the perform- 
ance of the control group serves as a benchmark against which to com- 
pare the performance of the experimental group. These designs are 
generally considered to be more reliable than available alternatives,' 
and FSA specifies their use in the JOBS evaluation.^ 

Thus, this review draws primarily on the growing number of studies 
that use this type of design. Also included is information from selected 
other evaluations. Because there are previous research reviews that cover 
earlier non-experimental studies,^ this discussion emphasizes relatively 
recent ones that evaluated treatments comparable to those in the 
experimental studies and that are directly relevant to the JOBS program. 

The synthesis focuses on two distinct types of impact and 
cost-effectiveness questions. The first is whether welfare-to-work 
programs and particular services are effective. This is a net impact 
question and is the usual bottom line of an evaluation. The second is 
whether certain welfare-to-work services (or different wayc of organiz- 
ing such services) are more effecHve than others. This is a differential 
impact question and has rarely been addressed with the same rigor in 
prior evaluations because it requires a random assignment design that is 
more complex and demanding to implement. 

Because this book exan-, ines a la rge number of studies in considerable 
detail, many readers will find it useful to begin with an overview of the 
book's main findings. Therefore, Chapter 1 sets forth the central 
conclusions and policy implications from the completed welfare-to- work 
studies of the 1980s. Later chapters present the analysis on which these 
conclusions are based and the lessons of the research. Chapter 2 briefly 
reviews the evolution of state welfare-to-work programs and the dis- 
tinctive features of the JOBS legislation. It then provides a framework for 
both the JOBS evaluation and this volume by identifying the dimensions 
of a welfare-to-work program and the local context that can affect 
program impacts. It concludes with the discussion of some of the issues 

' For example, two recent panels established to examine the record of alternative approach- 
es - I.e., non-experimental designs - used in numerous evaluations of employment and 
traming programs funded under the Comprehensive Employment and Training Act 
(CETA) highlighted the problematic results of those studies and urged greater use of 
classical, random assignment field experiments. See Betsey, Hollister, and Fapageoreiou, 
1985; Job Training Longitudinal Survey Research Advisory Panel, 1985. 
^ Family Support Act of 1988, Title II, Sec. 203. 

^See, e.g., Goodwin, 1977; Gordon, 1978; Gueron and Nathan, 1985; Malone, 1986. 
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that arise in estimating program impacts and making comparisons 
across evaluations. Chapter 3 describes the data base for this synthesis, 
identifying the nature and status of the range of available studies. 
Chapters 4 and 5 contain the core of the analysis; They outline the 
findings (and the forthcoming studies) on each of the key welfare-to-work 
program dimensions and impacts, overall and for relevant subgroups. 
These chapters contain the lessons of research for JOBS policymakers. 
Based on this summary, Chapter 6 identifies major gaps in knowledge 
that constitute the challenge for future research in this area. 

By summarizing what is known about the effectiveness of 
welfare-to-work programs, this book focuses on one major element of all 
recent proposals to redesign welfare with the goal of encouraging 
self-support and reducing long-term welfare receipt: requiring people 
on welfare to participate in employment-directed services. Programs 
and proposals have varied in their emphasis on carrots or sticks, but the 
basic vision of recent reforms is to change AFDC from a means-tested 
entitlement (where benefits depend only on income and assets) toward 
a reciprocal obligation . This would require welfare recipients to seek em- 
ployment or participate in some form of employment-directed service, 
or risk losing some or all welfare benefits; at the same time, government 
agencies would be responsible for providing welfare-to-work services 
designed to help people get jobs. 

While this new vision of a social contract has been a central element 
of reform proposals since the late 1960s, the recent proposals also reflect 
another concern: Even if they meet their goals, welfare-to-work programs 
may simply move families on welfare into the ranks of the working poor, 
rather than getting them out of poverty. This has raised the issue of the 
value of complementary policies specifically designed to reduce poverty 
by providing alternative sources of income that increase the returns from 
part- and full-time, low-wage work. Examples of suggested reforms 
designed to ''make work pay" include: strengthening the child support 
collection system (a key element in FSA); having the federal government 
guarantee child support payments if fathers do not pay (the Child 
Support Assurance concept); instituting a children's allowance or a 
refundable tax credit for families with children; further increasing the 
Earned Income Tax Credit (EITC), which was raised substantially in the 
Omnibus Budget Reconciliation Act of 1990; expanding health insur- 
ance and child care subsidies to the working poor; increasing the mini- 
mum wage; and ; roviding guaranteed jobs for welfare recipients who 

o - 
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cannot find unsubsidized work (usually proposed in conjunction with a 
limit on the length of time people can receive welfare).* 

This book assesses what past studies suggest about the potential and 
limits of programs such as JOBS that seek to restructure AFDC to move 
people from welfare to work. While the broader context of the problems 
of the working poor is not specifically addressed, it remains a critical 
backdrop to understanding the challenges that have faced administra- 
tors implementing welfare employment programs. Viewed this way, the 
other reforms mentioned above represent important complements that 
may increase the effectiveness of JOBS programs by strengthening the 
payoff of work. 



^Siv,i\g.,thepri)pt)salsinC;arfinkdnndMcUn.iluin, lW6;Hllwood, 19«8;h)rd l'ound.U^ 
1989. 
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The Findings in Brief 



Across the nation, states are implementing the many provisions of the 
Family Support Act. As they make the funding and design choices that 
will determine thesize and shapeot theJOBS program, policymakers can 
benefit from studies of earlier programs, for there is an extensive and 
reliable record of the accomplishments of pre-JOBS efforts to move 
welfare recipients into employment. The public can also join in debates 
on JOBS, aided by information from the record of completed wel- 
fare-to-work studies. However, translating this evidence into decisions 
about how JOBS programs should be structured, and what should be 
expected of them, is difficult. Tht abundance of findings, the lack of 
evidence regarding some new JOBS features, and the urgency of the 
policy task are apparent. Nevertheless, the pre jOBS record points to 
three key lessons: (1) Different services and program models have 
different payoffs for particulai groups within the welfare population, so 
targeting to get resources where they are likely to count most is central 
to JOBS planning. (2) There may be trade-offs in meeting program goals 
- notably, in both reducing welfare expenditures and maximizing the 
earnings of the people served in welfare-to-work programs. (3) 
Understanding the magnitude of possible effects of JOBS, and how such 
effects are achieved, is essential to resource allocation decisions. To 
provide the details of these themes and assist JOBS policymakers, this 
volume summarizes the lessons from some of the major recent studies, 
pointing out what is and is not known about critical JOBS choices. This 
chapter presents an overview of the bc>ok's main conclusions. 

For the past 25 years, AFDC has been criticized for failing to sufficient- 
ly reduce poverty among children and for discouraging poor parents 
from leaving welfare for work. With the creation of the WIN program in 
1967, Congress directed the states to reorient welfare toward work. But 
WIN, the vehicle for imposing requirements and mustering employ- 
ment-directed services, was judged inadequate for not delivering on the 
promise of change. 

During the 198()s, several factors increased confidence in the poten- 
tial of wel fare-to- work programs and helped shape the JOBS legislation. 
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First in response to new flexibility in federal rules, and despite shrinking 
federal funding, states demonstrated that they could design and im- 
plement programs that reflected their priorities and resources. Second, 
studies of a number of these state programs gave convincing evidence 
that a variety of approaches in a range of conditions could both benefit 
welfare recipients and produce budget savings that exceeded the initial 
investment. But these studies also suggested that the low-cost programs 
predominant during this period had modest effects and did not usually 
increase the employment of the most disadvantaged. In addition, JOBS 
reflected the research on welfare dynamics which showed that, while the 
majority of people used public assistance for only short-term support, a 
substantial minority remained poor and on welfare for long periods. 

The evidence of strong programs and positive results prompt- 
ed Congress to establish the JOBS program, which makes available in- 
creased funding to the states; to expand the population that could be 
required to participate in JOBS programs (to include women with 
preschool children); a nd to continue to encourage state diversity. The evi- 
dence of limited impacts and concentrated dependency also influenced 
the legislation. It prompted provisions in JOBS that set priorities and 
incentives intended to boost overall program i: ipacts and lead to greater 
success with long-term welfare recipients. These included: an emphasis 
on education and other intensive employment-directed services follow- 
ing an initial assessment; a focus on long-term recipients and those with 
high probability of remaining on welfare (such as young adults without 
high school diplomas and young custodial parents); and (through other 
titles of FSA) in-program and transitional support services. In response 
to criticisms of WIN, Congress also linked enriched JOBS hinding for 
states to their meeting program performance standards. 

As a result, JOBS simultaneously pushes states in two directions. On 
the one hand, it emphasizes human capital development and investi ng to 
increase the employability of long-term recipients. This suggests more 
expensive services. On the other hand, it establishes the concept of 
monthly participation standards and extends a participation mandate 
to a much-enlarged share of the AFDC caseload. This suggests serving 
more people. 

The early JOBS experience indicates that states are responding to the 
legislation's incentive,' by replacing the relatively simple programs of 
the 1980s (typically a fixed sequence of activities beginning with manda- 
tory job search) with more complex initiatives. These programs place 
greater emphasis on assessing service needs, offering choices, using 
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counseling and case management, focusing on those who volunteer for 
services, reaching long-term recipients, and providing education and 
training (usually through coordination with the education and Job 
Training Partnership Act [JTPAl systems). However, this early experi- 
ence also shows that many states, facing serious budget problems and 
competing pressures to fund other FSA provisions, are not putting up 
the funds required to draw down their entire federal matching allot- 
ment or to build JOBS programs of a scale to meet the full ambition of 
the legislation. Thus, budget constraints (even when mitigated through 
effective linkages with the education and training systems) suggest that, 
while the states face a requirement, in principle, to serve all adult 
recipients with children 3 years of age or older (the new ''non-exempt" 
caseload), no state will have the resources to provide comprehensive 
services to everyone in this group; for most, it is even doubtful that 
resources will enable them to provide low-cost services for the full 
non-exempt JOBS caseload. State administrators will have to choose 
how to allocate their resources. Regardless of the size of their budgets, 
they will have three potential responses: 

• Option 1: Operating a program that emphasizes low-cost ser- 
vices (primarily job search assistance) for a large portion of the 
caseload. 

• Optics) 2: Targeting more intensive, higher-cost components 
and case management on a smaller, more narrowly defined 
group and leaving the rest unserved. 

• Option 3: Designing a mixed strategy, with low-cost services 
for certain groups and higher-cost services for others, and 
reaching a share of the caseload in between those reached by 
the other two options. 

The JOBS legislation leads states toward Option 3 ~ the mixed 
strategy - and focuses state administrators' choices on hotv to target and 
structure more intensive, higher-cost services as well as the role of 
lower-cost components in a varied program. Making these choices 
requires critical decisions about the basic goals of the JOBS program in 
each state, including the relative emphasis on investing to improve job 
skills versus maximizing immediate job entries, and on raising earnings 
versus reducing welfare costs. Even after their initial JOBS program 
designs are in place, states will have to revisit these trade-offs several 
times as the phased-in provisions of the legislation take effect, resources 
change, and implementation lessons accumulate. 
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An Overview of the Findings from 
Pre-JOBS Programs 

In an effort to inform federal and state policy decisions about JOBS 
and to clarify the agenda for further evaluation, this volume synthesizes 
completed and in-progresi; studies that examine total welfare-to-work 
programs or components of them. In presenting the results, it makes a 
critical distinction between clear findings that a program was or was not 
effective a nd uncertai nty owing to the lack of a reliable study to determi ne 
its effectiveness. It also points out the ways in which JOBS may differ from 
the earlier approaches, qualifying the application of their results. 
Throughout, tae emphasis is on programs serving single (generally 
female) parents, who head more than 90 percent of all AFDC families. 

The main findings from studies of pre-JOBS programs are: 

• A range of welfare-to-work prs'^^^rams - those that emphasize 
immediate job placement as well as those that provide some 
more intensive services - can produce sustained increases in 
employment and earnings for single parents on welfare and a 
clear payoff on the public's investment. 

• Analysis of the response of subgroups of the AFDC population 
to programs that provided primarily low-cost services showed 
that the most job-ready have not been helped; earnings gains 
have been concentrated on a middle group; and most of the 
welfare savings (and smaller and less consistent earnings gains) 
have come from a more disadvantaged group. The lessons for 
program targeting thus depend on whether the objective is 
increasing earnings or producing welfare savings. 

• Programs that have produced increases in earnings have not 
always succeeded in reducing welfare expenditures, while those 
that have achieved welfare savings have not always produced 
net income gains for those whose welfare receipt was reduced. 
Thus, different program goals will affect how states use the 
available evidence to structure their program models. 

• While substantial evidence shows that moving women from 
welfare to work is feasible, it also suggests that expectations 
should be modest. Caseload reductions have not been dramatic 
and increases in people's standard of living have been limited. 
This suggests H) that it is important to learn in future studies 
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whether programs that focus on increasing welfare recipients' 
human capital - such as their educational and occupational 
skills levels - can produce better results, particularly for poten- 
tiallong-term recipients^ and (2) that policies directed at provid- 
ing income to the working poor are likely to play an important 
role if the goal is not only to decrease welfare receipt but also to 
make a meaningful reduction in child and family poverty . 

• The knowledge base is limited for comparing programs that 
offer more intensive versus less intensive services. This is be- 
cause there are no completed studies of large-scale programs 
emphasizing education or skills training. However, findings 
from a Baltimore demonstration and from San Diego's Satura- 
tion Work Initiative Model (SWIM) - both of which combined 
jobsearchand work experience with some education and training 
~ augmented by results from small-scale tests of voluntary on- 
the-job training and subsidized employment point to the poten- 
tial of mixed -strategy JOBS programs. There are indications that 
such programs can produce larger impacts on earnings and get 
some people into higher-paying jobs. The results also suggest 
that programs that begin with job search (either as the only 
service or followed by otheractivitiesas part of a mixed strategy) 
prod uce greater welfa re savings per dolla r spent on the progra m. 

• Among large-scale programs directed at a cross section of the 
eligible welfare caseload, San Diego SWIM was unusual in pro- 
viding education and training following job search and work 
experience and in its strong enforcement of a participation 
requirement. It showed the potential of welfa re-io-work 
programs to make a more substantial difference than had 
previously been demonstrated, including for the first time 
increasing theearnings of men in two-parent cases. Results were 
particularly impressive for single parents already on welfare (a 
more disadvantaged group than the people who came on the 
rolls during the study period); their average earnings increased 
by $889 a year (or 50 percent) and average welfare payments 
decreased by $608 (or 13 percent). Since these averages include 
everyone who was required to be in the program - many of 
whom did not participate, receive any services, or obtain a job- 
the actual earnings gains of those who worked were much 
higher. 
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Together; these results suggest that; within a given budget; JOBS ad- 
ministrators may face a trade-off in meeting different potential program 
objectives: getting people into better-paying jobS; maximizing welfare 
savings; and increasing the self-sufficiency of potential long-term 
recipients. 

• Providing mandatory job search to large numbers of people may 
maximize welfare savings and job-holding; but by itself usually 
will not get people better-paying jobs or benefit the more 
disadvantaged. Providing mainly higher-cost; more intensive 
services to a selected population can get people jobs with 
somewhat greater earnings; but will produce lower welfare 
savings per dollar invested. (It is not clear whether the more 
intensive services will be effective for very disadvantaged people 
because few programs of this type have been tested and only one 
has focused on this group.) Strategies that mix higher-cost and 
lower-cost services may offer an opportunity to partially meet all 
of these objectives. 

In addition to producing the;;e findings; the studies of past 
welfare-to-work programs point to several areas where recurring 
uncertainties suggest caution for JOBS planners. There is very limited 
evidence on the effectiveness of key JOBS innovations: the expanded 
investments in education and skills training or the focus on teen mothers 
and other potential long-term recipients. (It is possible; foi example; that 
these programmatic and targeting changes could avoid the potential 
trade-off suggested by earlier findings.) There is also little knowledge 
about the relative impacts of voluntary versus mandatory programs; in 
part because the operational differences between voluntary and manda- 
tory approaches are often cloudy; rather than representing a clear 
dichotomy. The effects of different methods of managing program 
caseloads and determining which people should receive which services 
-potentially important to JOBS' effectiveness -are also not clear. Further 
welfare-to-work programs serving adults in two-parent AFIX families 
(usually the fathers) do not have a record of success comparable to those 
for single mother*^* Only a few studies included such families; and the 
results were mixed. Finally; there is also uncertainty on whether JOBS can 
elicit the gubernatorial and state ownership; commitment; and funding 
that may have been critical elements in the success of the earlier WIN 
Demonstration programs; which were explicitly state initiatives. 
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Studies conducted in the 1980s have provided a strong basis for 
action by resolving a major issue: v^hether v^elfare-to-v^ork programs 
can produce positive results. The ansv^er is clearly yes, and Congress 
acted on that ansv^er by creating JOBS. But the question of v^hether JOBS 
will go beyond past successes sets a compelling agenda for research in 
the 1990s. To address tlds, future studies should seek to determine: Will 
weifare-to-v^ork programs that incorporate JOBS' nev^ goals and servic- 
es produce greater impacts, particularly for subgroups of the welfare 
population that were not usually helped by prior efforts? What are the 
most effective ways to design and target welfare-to-work programs? 
Can the budget savings achieved in some of the programs of the 198Us be 
maintained while more money is spent in JOBS for certain subgroups? 
Or, if JOBS results in lower returns to the taxpayer in welfare savings, 
will these be balanced by greater gains in employment and earnings for 
the welfare recipients who are targeted for larger investments? After 
describing the studies and their results, this chapter concludes with a 
discussion of the major open questions facing policymakers and 
researchers as they confront the choices that JOBS poses. 

The Studies of Welf are-to-Work Programs 

A substantial number of studies examine the effectiveness of 
welfare-to-work programs. A good starting point for interpreting them 
is the extensive research on welfare dynamics, which shows that many 
people leave welfare - sometimes because of employment, more often 
because of marriage and other reasons - with no special program 
assistance. This underlying caseload turnover, which varies with local 
labor market conditions, AFDC grant levels, caseload characteristics, 
and the extent of existing community services, makes it very difficult to 
determine whether a new welfare-to-work program is making a ditfer- 
ence. Uncertainty about how much caseload turnovei is normal and how 
much is attributable to the welfare-to-work program - combined with 
consistent evidence that funding is inadequate to serve all eligible peo- 
ple - has prompted policymakers increasingly to demand program 
evaluations that are based on random assignment field experiments in 
which, using a process similar to a lottery, potential program participants 
are placed in the program or in a control group. (Control group members 
are not eligible for special program services, but they are eligible for all 
other employment and training services in the community, as well as for 
all basic welfare benefits.) The activity of the control group shows the 
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employment and welfare behavior of people in the absence of the 
program; the program (or experimental) group shows the behavior with 
it; and the difference reliably isolates the effect or impact of the 
weJfare-to-work program itself. 

A growing number of evaluations have used this approach, and the 
authors of this synthesis focused on them in summarizing what is known 
about program effectiveness. This volume reviews 45 completed and 
in-progress studies that directly inform JOBS implementation. This 
chapter, however, centers on 13 completed studies of programs operat- 
ed primarily during the 1980s because they illustrate most clearly the 
choices that JOBS decisionmakers face. 

Table 1.1 presents the characteristics, costs, and impacts of those 13 
programs as studied (but omitting the AFDC two-parent component 
present in several of them). The studies are ranked by average net cost 
(i.e., in most cases, the operating agency's average cost per enrolled 
experimental minus any costs it incurred for controls) and are further 
grouped into two basic categories that are fundamental to interpreting 
their findings: those examining broad-coverage programs that 
encompassed entire service delivery systems and those focused on 
selective-voluntary programs, each of which was the equivalent of a 
program component within a broader system. 

• Studies of service delivery systems. One group of program 
evaluations included not only particular service components or 
providers but also administrative activities (such as intake, 
orientation, assessment and referral, case management, 
monitoring, and deregistration from WIN) that affected the 
coverage and allocation of services throughout the WIN or WIN 
Demonstration program. Together these services and 
administrative activities made up a service delivery system. 
Because the systems studied were intended to reach a wide 
range of AFDC eligibles, without selection or screening, they are 
referred to here as broad-coverage programs. Almost all of the 
completed studies in this category were of mandatory programs 
that, to varying degrees, required people to participate in order 
to receive their full welfare grants. 

• Studies of program components. Another group of program 
evaluations did not encompass full systems but, in most cases, 
looked at small-scale demonstrations of a component (or poten- 
tial component) of a much larger, broad-coverage program. All 
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Program 
(Ordered by 



Annual Impacts for All Years of Follow-Up 



Program Activities and 



Net Cost Per 



Experimental- 
Control 



3i 



Percent Change 
Over Control 



Net Cost) 


Study Characteristics 


Mandatoriness 


Experimental 


Outcome 


Difference 


Group Level 


Broad-Coverage Programs 


Arkansas 


Setjuence of group job search 


Mandatory; targeted 


3>l lo 


Earnings 








and (for a few) unpaid work 


AFDC applicants 




Year 1 




33% 


Program 


experience; low-grant state; 


and recipients with 




Year 2 


223 


23 




highly disadvantaged 


children 3 or older; 




Year 3 


337** 


31 




pvipumiiurif eviiiuailun uugiin 


falter • "HiiV 

iCW sancnons, »io a. 












in ivoj 


ever participated in 




ArlX. payments 










job search or work 




Year 1 


-$145*** 


-13% 






experience during 




Year 2 


-190*** 


-19 






9-month follow-up 




Year 3 


-168*** 


-18 


Louisville WIN 


Individunl job SLMrch; 


• 

Mandatory ana volun- 


$136* 


Earnings 






Laboratory 


low-grant stato; 


tary; targeted AriJv^ 




Year 1 


$289** 


IHVc 


Expenment- 


evaluation bt?gan in 1978 


applicants and recip- 




Year 2 


436 


li) 


Individual 




ients with children 




Year 3 


435**^ 


IB 


Job Search 




of any age; 55Vt ever 














participated in individ- 




AMX* payments 










ual job search during 




Year 1 


-S73* 








8-month follow-up 




Year 2 


-164**^ 


-8 








Year 3 




-10 


Cook County 


Sequence of individual job 


Mandatory; targeted 


SI 57 


learnings 






WIN 


sea rch a n d u n pa i d w ork 


AFIX- applicants 




Year 1 


$10 


l^r 


Demonstration 


experience; program provided 


and recipients with 












little direct assistance, mainly 


children b or older; 




AFIX' payments 








monitored and sanctioned 


many sanctions; 39'i 




Year 1 


-540 


-I'/c 




those who did not participate; 


ever participated in 












medium-grant state; highly 


any activity during 9- 












disadvantaged population; 


nionth follow-up 












evaluation began in !WS^ 
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Program 
(Ordered by 
Increasing 
Net Cost) 



Annual Impacts for All Years of Follow-Up 



Program Activities and 
Study Characteristics 



Coverage/ 
Mandatoriness 



Net Cost Per 
Experimental Outcome 



Experimental- Percent Change 
Control Over Control 

Difference Group Level 



Louisville WIN 
Laboratory 
Experiment- 
Group Job 
Search 



West Virginia 

Community 

Work 

Experience 

Program 

(CWEP) 



Group job search; low-grant 
state; evaluation began in 
1980 



Mandatory and volun- 
tary; targeted AFDC 
applicants and recip- 
ients with children 
of any age; 65% ever 
participated in group 
job search during 
6-month follow-up 



Open-ended unpaid work expe- 
rience; rural labor market 
with very high unemployment; 
low-grant state; highly dis- 
advantaged population; eval- 
uation began in 1983 



Mandatory; targeted 
AFDC applicants 
and recipients with 
children 6 or older; 
few sanctions; 24% 
ever participated in 
work experience during 
9-month follow- up 



$260 



Virginia Sequence of individual or 

Employment group job search, unpaid work 
Services experience, and some 

Program education or job skills 

(ESP) training (but only slightly 

more than controls received 
on their own); medium-grant 
state; disadvantaged population; 
evaluation began in 1983 



Mandatory; targeted 
AFIXT applicants 
and recipients with 
children 6 or older; 
few sanctions; 58'X 
ever participated in 
any activity during 9- 
month follow-up 



$430 



Earnings 

Year 1 $464* 

AFDC payments 

Year 1 -$40*^ 



learnings 

Yearl $16 

AFrX! payments 

Year 1 $0 



Earnings 

Year 1 $69 

Year 2 280* 

Year 3 268* 

AFDC payments 

Year 1 -$69 

Year 2 -36 

Year 3 -111» 



437« 



-2% 



4% 



0% 



14 
11 



-2 
-9 



San Diego I 

(Employment 

Preparation 

Program/ 

Experimental 

Work Experience 

Program 

lEPP/EWEPJ) 



Sequence of group job search 
and unpaid work experience; 
substantia! program assistance 
provided; high-grant state; 
less disadvantaged population; 
evaluation began in 1982 



Mandatory; targeted 
AFDC applicants 
with children 6 or 
older; many sanc- 
tions; 46% ever 
participated in job 
search or work 
experience during 
9-month follow-up 



$636 



San Diego 
Saturation Work 
Initiative 
Model 
(SWIM) 



Sequence of group job search, 
unpaid work experience, and 
education and job skills training; 
high participation and ongoing 
participation requirement; 
high-grant slate; less 
disadvantaged population; 
evaluation began in 1985 



Baltimore Choice of services, including 

Options individual or group job search. 

Program education, job skills training, 

unpaid work experience, 
nnd on-the-job training; 
program ct)nstrained to serve 
1 ,(XX) enrollees per year; 
medium-grant state; less dis- 
advantaged population; eval- 
uation began in 1982 



Mandatory; targeted 
AFDC applicants 
and recipients with 
children 6 or older; 
miny sanctions; 64'/( 
ever participated in 
any activity during 
12-month follow-up 



$919 



Mandatory; targeted 
AFDC applicants 
and recipients with 
children 6 or older; 
few sanctions; 45';! 
ever pr iucipated in 
any activity during 
l2-month follow-up 



$933 



ERIC 



3 



o 



Earnings 

Year 1 $443*** 23% 

AFDC payments 

Year 1 -$226*** 



Earnings 

Yearl $352*** 21% 

Year 2 658*** 29 

AFfX* payments 

Year 1 -$407*** -8% 

Year 2 -553*** -14 



Earnings 

Yearl $140 10% 

Year 2 401*** 17 

Year 3 511*** 17 

AFDC payments 

Year 1 $2 0^^ 

Year 2 -34 -2 

Year 3 -31 -2 



(amtiinu'd) 



TABLE 1.1 (cofitinued) 



Program 
(Ordered by 

Increasing Program Activities and Coverage/ 

Net Cost) Study Characteristics M andatoriness 



Annual Impacts for All Years of Follow-Up 



Experimental- Percent Change 
Net Cost Per Control Over Control 

Experimental Outcome Difference Group Level 



Selective-Volufttary Programs 



New Jersey 


Subsidized on-the-job 


Voluntary; targeted 


$787 . 


Earnings 






On-the-job 


training; enrollees quite 
i^isadvantaged in terms of 


seltHTted AFDC 


l$439r 


Year 1 




N/A 


Training (OJT) 


recipients over 18 




Year 2 


$591 


14Vt 


Program 


prior welfare receipt and 
recent work histories, but 


with children of any 
age; 40% participated in 




AFDC* payments 








hnd relatively high levels 


employment with OJT 




Year 1 


-$19()»*^* 


-6Vc 




of GED attainment; mediunv 


(84'^ ever participated 




Year 2 


-238* 


-11 




gnint state; evaluation 


in any WINor]TI'A 












begnnin 1984 


activity) during 
12-month follow-up 











Maine 


Sequence of employability 


Voluntary; targett»d 


$2,1)19 ^ 


Earnings 






On-the-job 


training, unpaid work expe- 


selwted unemployed 


I$l,635r 


Year 1 


$1()4 


8':; 


Training (OJT) 


rience, and subsidi/tni on-the- 


AFIX' recipients 




Year 2 


871** 
941*' 


38 


Program 


job training; enrollees quite 
disadvantaged in terms of prior 
welfare receipt and recent work 


on rolls for at least 
^<rior 6 months with 
children of any age; 




Year 3 
AFiX payments 


34 




hislorit»s, but had relatively 


9U7i ever participated in 




Year 1 


S64 






high U"'p1s of GHD attainment; 


nv activity during 




Year 2 


29 
80^ 


1 




medium-grant state; 


.^-month follow-up 




Year 3 


4 




evaluation bt»gan in 1983 
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AFDC 

Homemaker- 
Home Health 
Aide 

Demonstrations 



Job skills training and 
subsidized employment 
program; varied population, 
low-, medium-, and high-grant 
states; evaluation bi'gan 
in 1^83 



National 
Supported Work 
Demonstration 



Structured, paid work 
experience; targeted ex- 
tremely disadvantagcKi AFIX! 
recipients; low-, mtxiium-, and 
high-grant states; evalua- 
tion began in 1^76 



Voluntary; targeted 
selected AFDC 
recipients on rolls 
for at least 90 days 
who were not employed 
as home health aides 
during that time; 84% 
participated (i.e., 
entered training) 



$9,5()5 

($5,957-$! 2,4i>7 
across stiites) 
($5,684r 



Earnings 
Year 1 
Year 2 
Year 3 

AFDC* and FiKKi 



S2,026« 
1,347^ 
l,12lK 



/ 



Voluntary; targeted 
selected AFDC 
recipients on rolls for 
30 of prior 36 months, 
with children 6 or 
older; 97'-^ participated 
(i.e., showed up for 
their program job.') 



SI7,9«1 
l$9,4471' 



N/A 
N/A 
N/A 



Stamp Ix'nefits 






Year 1 


-$69h« 


N/A 


Year 2 




N/A 


Year 3 


-343« 


N/A 


Earnings 






Year 1 


$6,4()2***' 


327% 


Year 2 


1,368***' 


36 


Year 3 


1,076**** 


23 


AViX.' payments 






Year 1 


-S2,2(K)*** 


-39^; 


Year 2 


-l,lh3***' 


-26 


Year 3 


'401*** 


-10 



SOURCES: Data from the reports listed at the end of this chapter and additional iv..^^'^' estimates. 

NOTES: The cost estimates reporttni in this table are the net costs of these programs. These include all e\pc»nditures incurred specifically for the programs 
under study by the operating agency, plus any expenditures by other organizations for services that were an essential part of the program treatment, minus 
costs to the opi»rating agency or other organizations of serving members of the control groups. Stv Apnt-ndi) A for further discussion. 

Net costs and annual impacts are in nominal dollars except where noted. 

•^Tht' net cost is adjusttni to 1983 dollars. 

^he impact is adjustt^ to 1985 dollars. Year 1 begins with the (juarter ot random assignment. The annual earnings impact for year 3 is based on ime 
quarter ot follow-up. The annual AEIX: payments in;pact for year 3 is based on three quarters of follow-up. Statistical significance was not calculated for 
year 3. However, since the quarterly impacts are statistically significant, the annual impacts are assumccl also to be significant. 
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TABLE 11 (conthmed) 



^The impact is adjusted to 1985 dollars. The annual earnings impact is based on two quarters of follow-up. Statistical significance was not calculated. 
However, since the quarterly impacts are statistically significant, the annual impact is assumed also to be significant. The annual AFDC payments impact 
is based on four quarters of follow-up. 

The bracketed figure excludes wage subsidy payments for participants, whereas the other figure includes them. 

^Ayearleamingsimpact is notavailable in New Jersey forthe same samplcastheyear2impact and is therefore notshowti.Thoannualearnings impact 
for year 2 is based on three quarters of follow-up. Statistical significance was not calculated for year 2. However, since the earnings impact for quarters 5-7 
is statistically significant, the annual impact is assumed also to be significant. Similarly, the quarterly AFDC payments impacts for quarters 2, 3, and 4 of 
year 1 are statistically significant, so the annual impact is assumed also to be significant. 

Annual earnings and AFDC payments impacts for year 3 are based on three quarters of follow-up. Statistical significance was not calculated for year 
3. However, since the quarterly earnings impacts are statistically significant, the annual earnings impact is assumed also to be significant. 

^ross-state annual impacts are estimated from state-specific impacts presented in Table 5,2, so statistical significance and experimental and control 
group means are not a /ailable. Yearl isdefinedbytheoriginalresearchersasthenumberofmonthsfromrandomassignmentuntilthetypicalexperimental 
left subsidized employment. Year 2 is defined as the 1 2-month period following the time when the typical experimental left subsidized employment. Year 
3 IS based on all months in the follow-up period after year 2. Average annual impacts for each year were calculated by multiplying the average monthly 
impacts for that period by 12. Total earnings of the expt^rimental group mclude both demonstration and non-demonstration earnings. Since the 
Homemaker-Home Health Aide Demonstrations offered up to a year of subsidized paid employment, earnings and consequently reduced AFDC and Food 
Stamp benefits during the first two years partly reflect wages earned in the program, and not post-program impacts. In year 2, there were statistically 
significant gains in monthly earnings in all seven states and welfare savings in six. In year 3, there were significant gains in monthly earnings in five of 
the seven states and welfare savings in four. 

"Supported Work projects generated revenut»s of $4,352 pvr experimental (in 1985 dollars), which offset part of the cost reporttni here. 

'The impact is adjusted to 1985 dollars. Since Supported Work offered up to 18 months of subsidized paid employment, earnings and consequently 
reduced AFDC payments during the first two years partly reflect wages earned in the progiam, and not post-program impacts. The annual earnings and 
AFDC payments impacts for year 3 are based on quarter 9, the last quarter for which there are common follow-up data for all rec ipients who responded 
to the final sun'ey. AFDC payments impacts include impacts on General Assistance, Supplemental Stxrurity Income, and other unspecified cash welfare. 

♦Denotes statistical significance at the 10 percent level; at the 5 percent level; and *** at the 1 percent level. 



THE FINDINGS IN BRIEF 



of the completed studies are of programs that encouraged but 
did not require participation by a subset of the AFDC popula- 
tion and that could be ''selective'' in one or two ways: Eligible 
people could select whether or not to enroll, and program op- 
erators could select among eligible applicants. Because of these 
recruitment practices, in this document these are called 
selective-voluntary programs or demoi^strations. 

While it is too early to tell the extent to which state JOBS programs 
will correspond to these categories (or to a third that combines features 
of both), the two types of studies already provide lessons applicable to 
JOBS. Nine recent evaluations of broad-coverage, mandatory programs 
are of the greatest relevance. They assessed total WIN or WIN 
Demonstration systems (either at full or smaller scale) and supply 
information on impacts for a cross section of the then-mandatory (under 
WIN) caseload. The programs reflected the range of budget constraints 
likely to face states implementing JOBS. The average gross costs of 
operating these programs ranged from $162 to $1,545 per targeted eligi- 
ble person, among the five broad -coverage programs for which data 
were collected on the costs borne by outside agencies as well as by the 
welfare agency itself. (The former include, for example, Job Training 
Partnership Act agencies, which provided some employment and train- 
ing services to people referred by the welfare programs.) The net costs, 
shown in Table 1.1, were lower, because they did not include two items: 
the costs to the administering agency of processing and serving mem- 
bers of the control group and any outside agencies' costs for provision 
of services that were not an integral part of the program model. 

With the variations noted in Table 1.1, seven of the nine 
broad-coverage programs represented an Option 1 budget allocation - 
i.e., low-cost services for a large portion of the targeted eligible caseload. 
Typically in these programs, participation was more or less required of 
all eligible AFDC applicants and recipients with school-age children. The 
se^'ices generally consisted of relatively low-cost group or individual 
job search, sometimes followed, for those who did not find a job, by 
assignment to three months of unpaid work experience ("workfare"). 
Two of the broad-coverage programs reflect an Option 3 allocation - a 
mixed strategy combining low-cost services for most of the eligible 
individuals and higher-cost services for some -- and thus came closer to 
meeting the vision expressed in the JOBS legislation. These two 
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multi-component programs also reflected the main JOBS alternatives for 
deciding how to allocate and target intensive services. In Baltimore, a 
process of assessment, which incorporated case manager and recipient 
preferences, determined how people were assigned to a variety of 
employment-directed services (including job search, work experience, 
education, or training). In San Diego's Saturation Work Initiative Model 
(SWIM), services were provided in a fixed sequence, with education and 
training required and reserved for those who did not find employment 
as a resul' of job search and, following that, work experience. 

The four studies of selective-voluntary demonstrations described in 
Table 1.1 provide information relevant to JOBS' new emphases on 
targeting and intensive services. They included several more intensive 
on-the-job training and subsidized employment approaches that could 
be part of an Option 2 or 3 allocation strategy. The demonstrations were 
targeted to particular groups of AFDC recipients, who were motivated to 
seek out services and (usually) were screened on specific eligibility 
criteria. Two of these - the subsidized on-the-job training (OJT) program 
in New Jersey and the sequence of services (including OJT) in Maine - 
while relatively small, operated at a scale that was consistent with 
traditional WIN programs, given their selection and screening practices. 
The simpler New Jersey model is most relevant to future programs 
because it tested a straightforward OJT component, which is a JOBS 
option and can feasibly be afforded. The others - the Supported Work 
and Homemaker-Home Health Aide demonstrations - were multi-site 
demonstrations of activities that are less likely to be affordable and 
prevalent in JOBS programs. The former provided structured, paid work 
experience; the latter, training and subsidized employment. None of the 
four studies examined the effectiveness of education or classroom train- 
ing in the forms encouraged by JOBS. 

These 13 studies constitute a major body of knowledge on the 
effectiveness of employment programs for welfare recipients. But, for 
several reasons, it is difficult to use them to reach firm conclusions ^bout 
the relative impact and cost-effectiveness of various broad-coverage and 
selective-voluntary approaches in order to design successful JOBS 
programs. In particular, this volume argues for caution in comparing 
results from these two categories of studies because of fundamental 
differences in the program and evaluation designs. Broad-coverage, 
mandatory programs are intended to spend resources and have impacts 
on participants through (1) their receipt of education and employment 
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services, job placement, and other direct services, and (2) monitoring, 
counseling, and the threat or reality of monetary sanctions. However, 
broad-coverage programs also monitor, counsel, and sanction (or threat- 
en to sanction) nonpartici pants, whose behavior the program is thereby 
expected to affect as well. In contrast, selective-voluntary program.s are 
intended only to affect people who actually participate in program 
services. (Throughout this volume, the words "participant ' and 
"participation" refer to persons who actually attended the program's 
employment, education, or training activities. This is distinct from other 
members of the experimental group who took no part in the program 
whatsoever or who attended only WIN registration, program orienta- 
tion, assessment, or counseling, but did not actually spend time in a pro- 
gram component.) 

This distinction is mirrored in the way the two types of programs are 
typicallyassessed. Evaluations of broad-coverage programsstudy people 
who are actually subject to the program's mandate, even if they do not 
participate in employment-directed services; evaluations of se- 
lective-voluntary programs focus on participants. Thus, the measured 
impacts of broad-coverage programs provide information on the effect 
of a system (not just its employment-directed services) on the diverse 
people subject to its requirements, only some of whom participate. In 
contrast, estimatesof the impactsof selective-voluntary programs reflect 
how a particular component of the system (i.e., a service or set of services) 
affects the subset of the caseload who volunteer, most of whom pa rticipa to. 

This evaluation design difference is important to JOBS decision- 
makers who are trying to use research results to guide program design 
choices. The studies generally show larger average impacts for 
selective-voluntary than for broad-coverage programs, but that does not 
necessarily mean that the former's employment-directed services were 
more effective. Instead, the impact differencN*" may reflect other factors, 
e.g., higher participation rates or targeting a subgroup that was more 
likely to benefit from services. Such factors are often overlooked in sum- 
maries of the lessons from the studies discussed in this volume. 

An additional caution to JOBS decisionmakers concerns compari- 
sons across sites: The group of 1 3 programs operated under widely vary- 
ing conditions - different labor market and AFDC caseload characteris- 
tics, as well as AFDC grant levels and alternative community services. 
Further, thereare particular problems in contrasting the costs of programs 
in the two categories of studies, since the higher costs for the four 
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selective-voluntary programs reflected, in part, the inclusion of subsi- 
dized wages that may have led directly to offsetting AFDC savings. The 
costs of Supported Work are particularly difficult to compare to those of 
the other programs. Inflating the mid-1970s estimates may have pro- 
duced some distortion. In addition. Supported Work not only spent the 
most on participants' wages but also incurred substantial expenses that 
were subsequently offset by revenues received from the sale of program 
services, reducing the net budget cost below that shown in Table 1.1. 

Finally, none of the 13 programs specifically tested key JOBSand FSA 
innovations, such as the emphasis on education or the provision of 
continued support services (child care and Medicaid) to welfare recipients 
who go to work and leave welfare. These issues point to the need for 
additional studies, including those specifically designed to facilitate 
direct comparisons of different welfare-to-work program approaches. 

The Results of Key Studies 

Findings on Participation 

The broad-coverage programs provide benchmarks for participation 
rates in JOBS. But there are two major caveats: None of the programs 
operated under JOBS' monthly participation standards, and none of the 
evaluations measured participation according to JOBS' criteria. 

• Welfare-to-work programs proved capable of serving a sub- 
stantial share of the caseload in broad-coverage programs, 
some of which were large-scale. 

In the nine broad-coverage programs, between 38 and 65 percent of 
all targeted people took part ir\ a specific employment-directed activity 
(excluding orientation, assessment, or counseling) within six to twelve 
months after applying for welfare or registering with the program. To 
achieve these rates, staff had to work with a much larger share of the 
caseload, many of whom did not participate in employment services 
because they subsequently left welfare, were no longer eligible, or were 
deferred from participating. 

In programs that provided a fixed sequence of services, participa- 
tion was two to three times higher in the first than in subsequent compo- 
nents, as a result of normal welfare caseload dynamics and job placti- 
ments from the initial activity. Tht- two more intensive broad-coverage 
programs - Baltimore and San Diego SWIM - involved roughly a fifth ol 
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eligibles in education or training. The nrtandatory program with the 
highest monthly participation and the greatest proportion of those who 
ever participated in an activity - San Diego's SWIM program - was also 
the one with the most consistent and, generally, the highest impacts. 

The studies also showed that a surprisingly large number of people 
in both the experimental and control groups participated in education 
and training services on their own, so that the net increase in those 
services (and the net cost shown in Table 1.1) was often substantially 
below the total service level (and the gross program cost). 

• None of the broad-coverage programs would have met the 
participation standards that have been established by the 
J03S legislation and regulations. 

To obtain full federal matching funds under JOBS, states must have 
an increasing share - reaching 20 percent in fiscal year 1995 - of JOBS 
eligibles participating in certain allowable activities during each month. 
SWIM provides the most relevant data on the likelihood of programs 
meeting the JOBS participation standards. There are several reasons for 
this. First, among the mandatory, broad -coverage programs studied, 
SWIM had the highest longitudhul participation rate 64 percent of 
eligible individuals participated within 12 months of registering for the 
program. Second, SWIM required a cross section of the AFDC caseload 
to participate in various program components on a conthming basis. 
Third, the study was explicitly designed and funded to help establish 
expectations about maximum feasible monthly participation rates. The 
SWIM study found that monthly participation rates averaged 22 percent 
if only program-arranged activities were counted, 33 percent when 
self-initiated education and training were added, and 52 percent if 
part-time work was also included. The evaluation concluded that these 
rates were close to the maximum possible for the SWIM approach. While 
these monthly rates appear very high, the numerous differences be- 
tween what is included in the numerator and denominator of the SWIM 
participation rate and the standard established for JOBS make it hard to 
predict what the rates would have been had the JOBS rules been applied 
during the SWIM demonstration. Moreover, it is impossible to judge 
how San Diego program administrators would have changed the SWIM 
rdo Jel and daily program operations had they been striving to meet the 
JOBS participation standards. It is very likely, however, that SWIM as it 
operated in the pre-JOBS era would not have met the JOBS standard. 
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principally because most SWIM activities did not offer services for at 
least 20 hours per week, which is a major determinant of who qualifies as 
a "countable" JOBS participant. 

Impacts on Employment and Earnings 

• Almost all of the welfare-to-work programs studied led to 
earnings gains. This was true for both low- and higher-cost 
programs and services, and for broad-coverage and 
selective-voluntary programs. 

The studies of AFDC welfare-to-work programs provide a remark- 
ably consistent record. Seven of the nine broad-coverage programs led to 
increases in average annual earnings, ranging from $268 to $658 in the last 
year of follow-up. Depending on the program, this was 1 1 to 43 percent 
above the annual earnings of people in the control group. The smaller- 
scale, selective-voluntary programs increased average annual earnings 
by $591 to $1,121 - 14 tp 34 percent above the control group's earnings. 
(See Table 1.1.) These earnings gains take on greater significance because 
they are averages for all people eligible for or enrolled in the program, 
including those who did not work and did not actually receive any 
services. While the studies did not look behind the averages to determine 
the distribution of earnings gains, the findings suggest that gains were 
much more substantial for some people and minimal for others. 

• Earnings impacts for both low-cost job search and higher-cost 
programs were sustained for at least three years after program 
enrollment 

Job search programs are designed to have an immediate impact on 
employment; in contrast, education and training programs make an up- 
front investment in anticipation of larger future returns. Surprisingly, 
these studi'^s show that short-term impacts from lower-cost programs 
were sustained over at least three years. This is also the case for the 
broad-coverage programs that included some higher-cost components, 
and for the selective-voluntary programs. The Baltimore program, one of 
the few to include education and training services, suggests that t^.ese 
may have a different time path of impacts, with low iaitial gains increas- 
ing markedly during the second and third years after enrollment. (See 
Table 1.1.) Completed studies do not address the five- or ten-year results 
of these approaches, findings thai will be important in judging their 
ability to meet JOBS' goal of reducing long-term dependency. 
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• Broad-coverage programs that began with mandatory job 
search increased both employment rates and average earn- 
ings, but usually did not get people higher-paying jobs. There 
is limited and inconsistent information on the effect of un- 
paid work experience. Selective-voluntary programs that 
provided higher-cost or more intensive services appeared to 
get people into jobs with somewhat higher earnings, but did 
not make a consistent difference in the proportion of people 
employed. Broad-coverage programs that included some 
higher-cost services had greater average earnings impacts 
than those that did not. 

Earnings impacts result if programs cause a change in the number of 
people working, the number of hours people work, or their hourly 
wages. Completed studies suggest that different program approaches 
act differently on these three earnings components. Studies of broad- 
coverage prognms provide compelling evidence that job search alone 
and the job search/work experience sequence produce modest, but 
nonetheless relatively long-lasting, impacts on employment rates and 
earnings. These services almost always led to more people working, but 
they did not seem to increase the amount people earned while employed. 
Because job search was the first and most used component in the studies 
of a job search/ work experience sequence, it probably produced most of 
the programs' impacts. (Several of the studies examined whether un- 
paid work experience had an independent effect. One, in West Virginia, 
found that it did not, and another, in San Diego, showed positive but 
not robust results.) 

In contrast, findings on the four selective-voluntary programs point 
to the potential of more intensive approaches for getting people into jobs 
with somewhat higher wages or hours. In fact, they had most of their 
effect through augmenting the earnings of those who would have 
become employed without the program, and relatively little through 
increasing employment rates. Taken together, these studies also suggest 
a relationship between program cost and average earnings gains, with 
higher impacts for the Supported Work and Homemaker-Home Health 
Aide demonstrations than for the two lower-cost programs that 
emphasized on-the-job training. Importantly, Supported Work also 
showed that carefully structured, subsidized employment could produce 
sustained and relatively large impacts for very disadvantaged, long-term 
recipients. 
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There is very limited information on the relative effectiveness of 
welfare-to-work systems that did and did not contain some higher-cost 
components. None of the programs focused s' cificnlly on education, a 
key JOBS activity. However, the research suggests that including 
higher-cost, more intensive components (usually education and skills 
training) in broad-coverage programs that provided mainly job search 
and work experience led to larger absolute earnings gains per person in 
the study. As Table 1.1 shows, average annual earnings impacts in San 
Diego SWIM and Baltimore were somewhat higher than those in the 
lower-cost broad-coverage programs. 

The contrasting patterns of impacts described above are echoed in 
these two mixed-strategy, broad-coverage programs, one of which was 
more mandatory and began with up-front job search (SWIM) and the 
other of which was more voluntary and referred some people to educa- 
tion and training as a first activity (Baltimore). The SWIM program 
produced relatively large increases in earnings, most of which were a 
result of an increase in the number of people working. Baltimore had a 
smaller effect on long-term employment rates, but did improve the 
earnings of those working. The difference was reflected in the two 
programs' impacts on the earnings distribution of people who got jobs: 
SWIM increased the number of people with relatively low as well as rel- 
atively higher earnings and did not change the overall earnings distrib- 
ution, whereas the employment increase in Baltimore was concentrated 
in the higher earnings category. In these two different ways, and possibly 
because they provided some added education and training, both pro- 
grams increased thepercentof people earning moresubstantial amounts. 
In Baltimore, there was a 3.8 percentage point increase (compared to the 
control group) in the share of people earning more than $6,000 a year; in 
San Diego SWIM, there was a 4.6 percentage point gain in the proportion 
of all program eligibles who earned $5,000 a year or more and a 3.2 
percentage point increase in the share of AFDC recipients (a more disad- 
vantaged group than AFDC applicants) who earned $10,000 or more a 
year. However, these are only two studies, and the results may have been 
due to other elements: for example, SWIM's strict enforcement of an on- 
going participation requirement and its relatively high sanctioning rate, 
Baltimore's implementation at a relatively small scale, or the extensive 
experience and capacity of the administering agencies in both places. 

• Employment and earnings impacts did not occur when re- 
sources per eligible individual were too low to provide empioy- 
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menl'directed assistance or when programs were operated in a 
rural, very weak labor market. 

For states assessing whether to spread resources thin to increase 
program coverage or to concentrate them to increase service intensity, 
the studies provide a mixed message. Some very low-cost approaches 
(Arkansas and the two Louisville programs) did have positive 
employment impacts. However, the lack of success from the Cook 
County (Chicago) program may suggest that there is a threshold in this 
trade-off. When resources are so limited that staff can only process and 
sanction cases and provide virtually no direct assistance, even in the job 
search component, a program may have no effect on earnings. (While 
these four programs had similar costs, Cook County probably had the 
fewest real resources and used them more for monitoring and process- 
ing people than for providing direct services.) 

The other program without employment and earnings impacts was 
implemented in West Virginia, a rural state with extremely high 
unemployment. This pure work experience program achieved its plan- 
ners' goal of providing useful public services and work in exchange for 
welfare, but it did not lead to an increase in unsubsidized employment. 

Impacts on AFDC Payments and Receipt 

• Average welfare savings were smaller than earnings gains. 
The inclusion of more intensive, higher-cost services did not 
assure welfare impacts. 

Earnings gains were not always accompanied by welfare savings, 
and there was no consistent relationship bet ween thesizeof the earnings 
and welfare impacts. Three very different programs and conditions 
produced moderate reductions in the share of people receiving welfare 
at the end of follow-up: a decrease of 7 percentage points compared to 
controlsin low-grant Arkansas, high-grant California (San DiegoSWIM), 
and the multi-site Supported Work Demonstration. The other programs 
had a smaller or no effect on this measure (not shown in Table 1.1; see 
Chapters 4 and 5). In these same three programs, welfare payments 
declined by an average of $168 or 18 percent, $553 or 1 4 percent, and $401 
or 10 percent, respectively, in the last year of evaluation follow-up. Some 
of the other pr jgrams also produced welfare savings. (See Table 1.1.) 
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Broad-coverage programs emphasizing relatively low-cost, up-front 
job search led to fairly consistent welfare savings, but the savings were 
often small because not all of the jobs moved people off welfare. The two 
broad-coverage programs that also included some higher-cost compo- 
nents had the largest earnings impacts, but they produced very different 
welfare results: San Diego SWIM had the largest savings and Baltimore 
had none. The Mainestudy alsodid not translate relatively large earnings 
impacts into any significant welfare savings. The researchers did not pin 
down the reason for the lack of welfare impacts in Baltimore and Maine, 
but they concluded that the programs may have led to higher-paying jobs 
for people who (as shown by the control group) would have obtained 
woikand moved off welfare anyway or they may have increased the time 
on welfare for people involved in lengthy education or training activities 
(offsetting savings for others who were assisted in finding employment). 

Impacts on Different Groups Within the Caseload 

• The impacts of broad-coverage programs were not equal across 
all groups in the caseload. The most consistent and largest 
earnings gains were made by the moderately disadvantaged. 
The largest welfare savings were achieved for the more 
disadvantaged. There were usually no impacts - on earnings or 
welfare receipt- for the most job-ready. The lesson for targeting 
services to different groups within the welfare population thus 
depends on the relative importance placed on increasing earnings 
or reducing welfare costs. 

Studies of broad-coverage programs are of unique value for 
determining programs' effectiveness for subgroups of AFDC recipients 
because all members of a subgroup - and all targeted subgroups - are 
required to participate and are therefore present in the research sample. 
In contrast, subgroup estimates from selective or voluntary programs do 
not apply to the many subgroup members who were not selected or did 
not volunteer and are therefore not included in the research sample. A 
study of five such programs (excluding San Diego SWIM but including 
Baltimore) showed that the most employable people (e.g., women who 
were first-time welfare applicants and had recent work experience) had 
little or no gain over the benchmark established by similar people in the 
control groups. Even without special assistance, many of these women 
stayed on welfare for relatively brief periods. In contrast, a midd le group 
(e.g., people who had received AFDC before and were reapplying, 
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sometimes following their employment in a job with some limited earn- 
ings) had the most consistent earnings impacts from these programs, 
with gains averaging betv/een $450 and $850 a year after the first nine 
months of follow-up; comparefd to similar people in the control group. 
The more disadvantaged - those already on welfare, including longer- 
term recipients with no recent employment - did not show consistent or 
large earnings gains, but they produced a major share of the welfare 
savings. Even modest reductions in the number of longer-term recipi- 
ents can produce substantial welfare savings because their relatively 
lengthy periods of welfare receipt account for the bulk of AFDC expen- 
ditures. This phenomenon is apparent during the three-year follow-up 
period for the evaluations. 

• San Diego SWIM produced earnings and welfare impacts for 
AFDC recipients - who are more disadvantaged than 
individuals applying for AFDC - that exceeded those of other 
broad-coverage studies and equaled the levels achieved in 
much smaller, selective-voluntary programs. 

The SWIM program's success with AFDC rccipieuts is particularly 
impressive. Overall, this group is mure disadvantaged than AFDC 
apyp^licauts, and recipients did not benefit consistently from the other 
broad-coverage programs. During the second year of follow-up, the 
average AFDC recipient targeted by SWIM was earning $889 (or 50 
percent) more than theaverage for the control group and had $608 (or 13 
percent) less in welfare benefits. These earnings ^^ins compared favor- 
ably with the average impacts of the smaller, selective-voluntary pro- 
grams, even though SWIM's impacts were averaged across the full spec- 
trum of mandatory recipients - nonparticipants as well as participants, 
and the most disadvantaged as well as the more job-ready. The wdfare 
savings wt^re the highest found in a broad-coverage welfare-to-work 
program and exceeded those found in the selective-voluntary programs. 

It isMnclear which featuresofSWIMaccounted for its greater success 
with recipients than the programs that provided primarily job search and 
Baltimore's mixed strategy. Possible explanations include: the service 
sequence (up-front job search and work experience, followed by educa- 
tion and training), the strong enforcement of a continuous par- 
ticipation requirement, the extensive experience of SWIM program 
managers, or other characteristics of the San Diego environment and 
caseload. Moreover, since impact findings for subgroups of recipients 
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are not yet available, it is not clear whether these positive results extend- 
ed to the most disadvantaged recipients. However, the magnitude of the 
impacts suggests that they are unlikely to have been limited to the more 
employable recipients. 

• JOBS encourages states to serve people who are likely to 
become long-term welfare recipients. The research record is 
not strong as to whether intensive services can be more suc- 
cessful with this group than lower-cost services, particularly 
in producing earnings gains. 

In contrast to the strong evidence that low-cost services can prod uce 
consistent impacts for a moderately disadvantaged group, only one stu- 
dy confirms that wel fare-to- work programs can succeed with the least 
job-ready: very long-term welfare recipients with little or no prior 
employment. Supported Work specially targeted this group and served 
women who averaged 8.6 years on welfare. This program demonstrated 
that 12 or 18 months of paid, carefully structured work experience could 
produce sustained effects on earnings and welfare receipt for this group. 
But Supported Work was among the highest-cost programs studied. 
(See Table 1 .1 .) In light of Supported Work's large investment, it is partic- 
ularly important to determine whether SWIM did indeed benefit long- 
term welfare recipients(thisstudy is under way). Theother selective-volun- 
tary programs had positive impacts on selected AFDC recipients, but it 
isnotclearwhethprthey reached particularly hard-to-employ populations. 

Other Impact and Cost-Effectiveness Findings 

The cost-effectiveness results show a complex picture for different 
wel fare-to- work approaches. Typically, in a benefit-cost analysis, key 
questions include: Who benefits - program participants and/or the pub- 
lic at large? By how much? At what cost? Together, answers to these ques- 
tions provide information on the level of public investment associated 
with varying returns to different beneficiaries. Because the programs of 
the 1980s sometimes produced gains in earnings without associated 
welfare savings, and because of the variation in the magnitude of pro- 
gram results and resources, when impacts and cos^s are compared, the 
net benefits can point in different directions. This volume also presents 
other measures of cost-effectiveness that go beyond these more familiar 
indicators. Forexample, policymakers might consider the return provided 
towelfarerecipientsorthepublicperdollarinvested in a welfare-to-work 
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program. These different perspectives on the 13 broad-coverage and 
selective-voluntary programs underlie the cost-effectiveness results 
presented here. 

• Welfare-to-work programs usually benefited AFDC eligibles/ 
but generally led to only modest increases in their measured 
income. 

Table 1.1 indicates that, for both broad-coverage and selec- 
tive-voluntary programs, although the extra earnings from increases in 
work effort were often substantially offset by reductions in AFDC 
payments, there were modest increases in average combined income 
from the two sources. When estimated reductions in other transfer 
payments -e.g.. Medicaid and Food Stamps -and increases in taxes were 
also considered, benefits to welfare recipients usually continued to out- 
weigh losses, although the net benefits were small. Only the Supported 
Work study measured the program's impact on the proportion of 
participating families living below the poverty level, and found no 
statistically significant long-term change, despite the relatively large 
earnings gains. 

As a result, the findings indicate that, while this range of 
welfare-to-work programs modestly improved people's income, they 
proved unlikely to move many people out of poverty. This suggests the 
limited potential of thf^se programs to help most welfare recipients 
obtain jobs with substantially higher wages, at least within the three 
years of follow-up, and points to the importance of determining v/hether 
programs that make a more conscious investmer ' in increasing human 
capital can do better. It also suggests that, if reducing poverty is the goal, 
other types of policies directed at providing more income to the work- 
ing poor will be important complements. 

• Welfare- to- work programs usually had a positive impact on 
government budgets. Public investments in a range of pro- 
grams were more than returned in increased taxes and reductions 
in transfer payments* 

Extensive benefit-cost analyses show that, while welfare-to-work 
programs require an initial investment, this is usually offset by subse- 
quent savings in transfer payments and increased taxes. For seven of the 
nine broad-coverage programs, the payback period was rapid: two to 
five years. In some cases, budget savings were substantial: e.g., every 
dollar spent on San Diego SWIM saved the government $3. 
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Taxpayers benefited less consistently from the higher-cost, 
selective-voluntary programs. Two of these - the Maine and Home- 
maker-Home Health Aide demonstrations -incurr-=»d net costs. The New 
Jersey and Supported Work programs produced net savings for the 
government, the former within three years and the latter over a 
substantially longer period. 

• Measured in terms of impact per dollar invested, lowcost job 
scaich/work experience programs produced larger earnings 
gains and, to some extent, welfare savings than programs that 
emphasized higher-cost components, suggesting the exist- 
ence of diminishing returns. 

In addition to the traditional evaluation measures discussed above 
(average impacts and net benefits), JOBS administrators may be inter- 
ested in cost-effectiveness as measured by a program's impact per dollar 
invested. A comparison of the average cost and final-year impact find- 
ings in Table 1 .1 shows that, as long as service levels exceed the threshold 
level suggested by the Cook County program, earnings gains and, 
somewhat less consistently, welfare savings per dollar outlay tend to 
decrease as program costs increase. For example, the annual earnings 
impact per dollar invested was $2 or more in the last year of follow-up in 
the low-cost Arkansas and Louisville job search programs; 50 to 75 cents 
in Virginia, San Diego 1, SWIM, Baltimore, and New Jersey; and sub- 
stantially less in Homemaker-Home Health Aide and Supported Work. 

• Evaluation results on welfare-to-work programs for AFDC- 
UP eligibles are limited. Available studies show welfare savings 
but do not always show earnings gains. 

FSA requires all states to implement a public assistance program 
for two-parent families: the AFDC-UP (Unemployed Parent) program. 
It also calls on states to involve (with eventual very high participation 
rates) at leastoneparent in these families inJOBSactivities that emphasize 
work. (For young parents who have not completed high school or its 
equivalent, education may be substituted.) In contrast to the strong 
record from numerous studies of pre-IOBS programs for single parents 
on AFDC (primarily women), there are few data on programs for fa- 
thers, usually the adult involved in AFDC-UP work programs, and none 
that allow a clear comparison among alternative program approaches. 

Only the two San Diego evaluations had sufficiently large samples to 
measure accurately the impacts of broad-coverage programs targeted at 
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AFDC-UPs. The study of the San Diego I program for applicants showed 
no statistically significant employment and earnings impacts. Average 
welfare savings of $374 were attained in the first year of follow-up. The 
San Diego SWIM study showed a consistent pattern continuing into the 
second year of follow-up, when the AFDC-UPs in SWIM were earning 
$454 (or 12 percent) more than the average for the control group and 
had $551 (or 12 percent) less in welfare benefits. Both programs pro- 
duced budget savings, but the men in the SWIM study only broke even, 
with their earnings gains about matching their losses from AFDC, other 
transfers, and tax payments. The men in the San Diego I study incurred 
net losses. 

Policy Trade-offs 

• Within a given budget^ administrators may face a trade-off 
in meeting different JOBS objectives - producing more sub- 
stantial earnings gains for some individuals, maximizing 
welfare savings, or reducing long-term dependency. Provid- 
ing mandatory job search to large numbers of people may 
maximize welfare savings and job-holding, but by itself usual- 
ly will not get people better-paying jobs or benefit the more 
disadvantaged. Providing mainly higher-cost, more inten- 
sive services to a selected population can get people jobs with 
somewhat greater earnings, but will produce lower welfare 
savings per dollar invested. It is not clear whether high cost 
programs will be effective for ver^* disadvantaged people 
because few programs of this type have been tested and only 
one has focused on this group. Administrators seeking to 
balance the JOBS objectives may favor a mixed strategy that 
combines higher-cost and lower-cost services. 

The JOBS program has multiple objectives, and administrators will 
differ in the importance they attach to particular ones. Some will aim to 
produce earnings gains that are large enough to substantially improve 
the well-being of families. Others will focus on maximizing overall 
welfare savings. Still others may emphasize reducing long-term welfare 
dependency. The three resource allocation strategies identified at the 
beginning of this chapter represent routes to meeting these varied 
objectives, in the context of JOBS' participation standards and target- 
ing objectives. Table 1.2 summarizes what past evaluations suggest 
about the strengths and limitations of the different options. 
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TABLE 1.2 RESULTS FROM COMPLETED EVALUATIONS 
OF WELFARE-TO-WORK PROGRAMS* 



Evidence on Option 1: Results of Low-Cost, Broad-Coverage Programs 
(Primarily Mandatory Job Search) 

• Consistent and sustained increases in employment and earnings 

• Rapid payoff ~ relatively large welfare savings per dollar spent 

But 

• Earnings gains mostly from increases in the number of people working and not from 
increases in earnings for those employed (i.e.; not from improved job quality) 

• Modest increases in welfare recipients' total income - many remain in poverty and 
on welfare 

• Not all groups benefited. Little or no impact on the most job-ready; earnings gains 
concentrated in a middle group; most of the welfare savings concentrated among 
the more disadvantaged; who showed no consistent earnings gains 



Evidence on Option 2: Results of Higher-Cost, Selective- Voluntary Programs 
(Primarily Subsidized Employment) 

• Consistent and sustained increases in employment and earnings 

• Some improvement in job quality - earnings gains mostly from increases in hours or 
wages and less from increases in the number of people working 

• Supported Work found to be successful with long-term recipients 
But 

• Slow payoff - relatively small welfare savings per dollar spent 

• Except for Supported Work; little information about success with the most 
disadvantaged 

• Many remain in poverty and on welfare 

• No completed studies of programs emphasizing education or skills training 



Evidence on Option 3: Results of Mixed^Strategy Programs 
(Combining Higher-Cost and Lower-Cost Services) 

• Can meet diverse objectives: some improvement in job quality; relatively large 
earnings gainS; and; in one of the two programs tested (San Diego SWIM); 
substantial welfare savings and success with the more disadvantaged 



NCyn*: "^In this tnble, increases, ^ains, and savings refer to differences between the experimental 
and control groups in the studies. 
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Administrators whose main goal is to maximize welfare savings 
may favor Option 1 (serving a large number of people with low-cost, pri- 
marily job search services), which will also enable them to produce some 
earnings gains. They can find support in the findings of sustained welfare 
and earnings impacts and cost-effectiveness from the broad-coverage 
programs of the 1980s. The Option 1 strategy would allow a state to serve 
large numbers of people and (as long as the program exceeds the service 
threshold suggested by the Cook County study) to produce the largest 
welfare sav ings and earnings gains per dollar invested and thus the 
highest aggregate impacts. (Aggregate impacts are the sum of impacts for 
all individuals exposed to the program.) However, evaluations showed 
that such programs did not usually help the most disadvantaged, and 
that those people who did become employed did not get higher-paying 
jobs. 

Administrators whose main goal is to get people into higher-pay- 
ing jobs may consider Option 2 (which would provide mainly intensive 
services). Those favoring this strategy anticipate that, in contrast to Op- 
tion 1, their approach may also be effective with more disadvantaged 
individuals and with those who would remain unemployed and on 
welfare if offered only job search assistance. Administrators weighing 
this option could find support for it in results showing that programs 
providing more costly, intensive services can get people into jobs with 
somewhat higher earnings (through higher wages, longer hours, or 
both). Most of the evidence for these findings can be found in the stud- 
ies of selective-voluntary programs. Option 2, however, also has limita- 
tions: There is no experience with such programs operated on the scale 
required to meet JOBS participation levels. Further, resource constraints 
virtually assure that only a small percentage of eligibles could be served, 
and (judging from studies of past programs) welfare savings per dollar 
outlay may be relatively low. 

Those interested in meeting all of these JOBS goals - improving job 
quality, achieving welfare savings, and reducing long-term depen- 
dency - might favor Option 3, the mixed strategy. This strategy - by pro- 
viding low-cost services (to assure immediate welfare savings) and more 
expensive, carefully targeted services (to benefit long-term recipients 
and get people into higher-paying jobs) - could allow states to serve a 
relatively large share of the welfare population and to target the most 
disadvantaged, both explicit goals of FSA. Available evidence from the 
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mixed-Strategy; broad-coverage SWIM program - and to a lesser extent 
the Baltimore program - provides support for this approach. Compared 
to the findings from programs that provided mainly lov^er-cost servic- 
es, results from these programs suggest that providing some higher^ost 
services can lead to greater average earnings impacts per person target- 
ed; and also (especially in Baltimore) get some people jobs with higher 
earnings. Both programs led to an increase in the percent of people with 
somewhat higher earnings (those earning more than $6,000 a year). As 
noted previously, the San Diego SWIM model stands out for the magni- 
tude of its impacts and (in contrast to Baltimore) both its success with 
welfare recipients (a group that is, on average, more disadvantaged than 
new applicants) and its relatively large impacts on both earnings and 
welfare savings. By combining low-cost job search services for the 
majority of participants with education and training services for some, 
SWIM produced gains that appear to have been more widely distributed 
among all categories of people on welfare than the gains of programs 
following the Option 1 approach. But here, too, there are drawbacks: 
Obviously, for the same budget, fewer people can be served in a mixed 
strategy than under the low-r jst Option 1 approach (possibly limiting 
aggregate welfart> savings). At the same time, fewer people will receive 
more enriched services than under the Option 2 model. 

Unfortunately, the natureofthetrade-off in reachingdifferent policy 
objectives,anditsapplicabnityfocurrentJOBS program models, remains 
highly uncertain. The completed studies of broad-coverage programs 
focused on approaches that were often different from those emerging 
under JOBS. The completed studies of selective-voluntary programs 
concentrated on intensive work experience and on-the-job training. 
Importantly, there is very little evidence of the effects of education for 
welfare recipients, which JOBS stresses. Also, follow-up was limited to 
at most three years, not an adequate time to determine the long-term 
effect of more intensive services, or to see whether the impacts of high- 
or lower-cost services increase or decrease over time. Moreover, there is 
very limited evidence on program effectiveness for women with young 
children, and on whether any large-scale component, even higher-cost 
ones, can succeed with very disadvantaged groups. In addition, there is 
uncertainty about the point at which any trade-off among program 
objectives would be affected by program scale; it is possible (although 
there is no evidence on this) that diminishing returns may set in if 
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particular welfare-to-work services arc provided to an expanded share 
of the caseload. Finally^ the relative cost-effectiveness of low- and high- 
cost services may not be the same under FSA as it was in the pre-JOBS 
period. One potentially major factor is the introduction of a year of 
transitional child care and Medicaid for people who leave welfare for a 
job. This may reduce the total savings that might otherwise ha v j accrued 
from people taking low-wage jobs. 

Critical Unanswered Questions 

The knowledge summarized here is the product of rigorous field ex- 
periments on pre-JOBS welfare-to-work programs. However, the Family 
Support Act and its JOBS title confront administrators with new choices 
and challenges. They are simultaneously urged to build more complex 
programs, reach a larger share of the caseload, succeed with new and 
more disadvantaged populations, provide mon? intensive services 
(including some that are untested in the welfare- to- work context), and 
offer expanded in-program and transitional support services. To deliver 
on JOBS' promise of increased effectiveness, they need new information 
that will guide them in matching services to people, and in allocating 
resources between employment-directed activities and case manage- 
ment and oversight. 

If mixed-mode program designs will predominate in the wel- 
fare-to-work environment of the 1990s, then JOBS administrators will 
need information to help them determine the optimal mix for their 
diverse caseloads, labor markets, AFDC benefit levels, and communi- 
ties, within their particular JOBS resource constraints, and given their 
individual policy preferences. 

Providing this information requires a new generation of studies that 
build on the existing lessons and refine the answers to a fundamental 
question: What works best for whom? Under JOBS, both the "what" and 
the "whom" have changed, with the new emphasis on education and 
training, for example,and incentives to serve moredisadvantaged groups. 
Indeed, the understanding of what "best" means may well change un- 
der JOBS, too; a major impetus for the Family Support Act was the pol- 
icymakers' hope that the welfare system, with more resources, could do 
better at moving AFDC recipients into employment and self-sufficiency. 
Fortunately, more than 20 studies are currently uncitT way that will 
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address some of the open questions highlighted here. (These studies are 
described in later chapters.) The JOBS evaluation, funded by the U.S. 
Department of Health and Human Services (HHS), is being structured to 
answer others. The most critical unanswered questions include: 

• Will greater investments in education and training lead to 
larger impacts? Will additional gains justify the expanded 



In deciding how to respond to JOBS' pressure to both reach more 
people and provide more intensive services, the most critical uncertain- 
ties facing administrators are the unknown impacts and cost-effectiveness 
ofprovidingeducation and otherintensiveser/ices for long-term welfare 
recipients. State JOBS programs are placing larger numbers of welfare 
recipients in education components, based on a belief that poor reading 
and computation skills prevent people from getting jobs that pay enough 
to support a family. The goal is to provide the most disadvantaged 
welfare recipients with enough education to help them obtain good jobs 
and move out of poverty. What will be the result of these efforts? 

Although there is a great deal of cross-sectional research (mostly on 
the non-welfare population) showing that those with higher education 
levels have higher earnings, there is very little evidence on the key cause 
and effect question - i.e., will the expansion of educational activities for 
welfare recipients help them leave welfare? Completed studies examine 
only a relatively nar-ow range of outcomes and do not even address the 
question of wl ^road-coverage programs that emphasize educa- 
tion are able to im^^rove participants' educational achievement levels. 
The evaluations of the SWIM and Baltimore programs - which provided 
substantial amounts of both education and training - offer the most re- 
liable information currently available on the longer-term impact of add- 
ing these more intensive services to broad-coverage welfare-to-work 
systems. While these studies were not designed to provide separate 
estimates of the effectiveness of the education and training components, 
their sizable overall earnings impacts, compared to programs that did 
not offer education and training; provide some basis for encouragement. 

Given the remaining uncertainty, results from an ongoing evalua- 
tion of California's broad-coverage welfare-lo-work program. Greater 
Avenues for Independence (GAIN), will be highly relevant, since the 
program places an unusually heavy emphasis on education. The GAIN 
study will be the first to assess the impact of a broad-coverage progi im 
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on educational achievement as well as on a wide range of economic and 
non-economic outcomes. In another study, the selective -voluntary 
Minority Female Single Parent (MFSP) Demonstration, init^l findings 
from the four service providers were mixed. The providers, which 
differed substantially in their serviceh and service delivery, offered 
relatively intensive education and training to low-income minority 
women. During months 10 through 12 after program enrollment- when 
some people were still in the program, forgoing work and "investing" in 
education and training in anticipation of future returns - experimentals' 
employment and earnings already exceeded those of controls at one site 
and had caught up with controls at the other three. (It will be important 
to see whether longer-term follow-up for the full N4FSP sample confirms 
the initial reports on the early program entrants, which suggest that the 
differing site impacts may persist 30 months after program enrollment.) 
The MFSP researchers offer a number of possible explanations for the 
greater early success at one site: job skills training that was integrated 
with remedial education and open to all (regardless of educational skills), 
greater operating experience and higher-quality services, stronger links 
to employers;, local labor market conditions, and the availability of 
high-quality on-site child care. They note that it is impossible to isolate 
the influence of any one of these factors because of the study design, the 
limited number of sites, and the short-term nature of the findings. 

Given the small number of studies examining large-scale 
welfare-to-work systems that emphasize education and training for a 
cross section of welfare recipients determined to need these services, 
there remains a clear need for further evaluations. These should include 
studies of programs using various education and training approaches 
and levels of service intensity to understand the benefits and costs of 
developing welfare recipients' human capital in this way. Evaluations 
that directly compare this approach to programs that do not emphasize 
education and training have not yet been carried out, and are greatly 
needed. In these studies, long-term follow-up will be important 
(particularly given the Baltimore finding of increasing impacts over 
time), since education represents a substantial up-front investment that 
is unlikely to show a payoff within a short period of time. 



• Can programs for young mothers prevent long-term welfare 
receipt? Can program impacts for the most disadvantaged 
welfare recipients be improved, and will services for these 
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groups be cost-effective? Will JOBS be successful for mothers 
with younger children? 

A major policy thrust of the Family Support Act is to prevent 
long-term welfare receipt This objective is reflected in several key JOBS 
provisions that specify target groups und establish participation 
requirements. States are required to meet expenditure goals for service 
to the most disadvantaged groups; in st)rne cases, the type of service 
(primarily education) is prescribed, 

JOBS' establishment of a school requirement for young custodial 
parents is an innovation based on as yet untested assumptions. Ongoing 
studies of Ohio's Learning, Earning; and Parenting (LEAP) program 
(which requires attendance in school programs leading to a high school 
diploma or in a General Educational Development [CtED] program and 
provides child care and other support services) and HHS's Teenage 
Parent Demonstration (which requires participation in education and/ 
or training, and provides life skills instruction, job search assistance, 
and support services) test mandatory programs for teen parents that 
combine services with financial sanctions and, in the case of LEAP, fi- 
nancial incentives in the form of increased monthly assistance payments 
for regular school attendance. It is not yet clear whether other states' 
approaches to mandatory education for young people will resemble 
these programs. 

A very different vision of how to prevent long-term welfare receipt 
among teenage mothers is examined by studies of selective-voluntary 
programs offering more intensive services. Among these, the New 
Cha nee and JOBSTART demonstrations will yield information on drop- 
out recovery programs for young women on welfare. New Chance pro- 
vides participants with comprehensive education and training, and 
employability, life management, and parenting instruction (along with 
child care). JOBSTART offers volunteers a non-residential program 
loosely modeled on the Job Corps, and including education, training, 
job placement assistance, and support Servians. JOBSTART's initial results 
showlargeimpactsonGEDattainment.Inaddition, the completed study 
of Project Redirection (which offered services intended to help drop- 
outs and potential dropouts to complete their education, increase their 
parenting and life management skills, and enhance their employability) 
showed promising results for young prvgnant and parenting teens 
receiving AFDC, some of whom were still in school when they enrolled 
in the program. Even more than programs that emphasize education for 
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adults, those for young people will require evaluations that use long- 
term follow-up to measure thedelayed benefits (if they exist) of investing 
in education to improve employment and earnings and to shorten the 
length of time public assistance is received. 

Regarding long-term welfare recipients, in those welfare-to-work 
programs of the 1980s that included them, the results were mixed. Sup- 
ported Work was effective in increasing theemploymentand earnings of 
this group, but at a cost probably beyond the resource capacity of most 
JOBS programs (at least for implementation at any substantial scale). 
Low-cost programs beginning with job search were sometimes effective 
in reducing the welfare receipt of the most disadvantaged segment of 
their caseloads, but not generally at improving their earnings. The per- 
tinent results from the mixed-strategy SWIM program are not available 
yet. Thus, the unanswered question for JOBS is whether there are ser- 
vice components or programs for long-term recipients that are feasible 
and affordable at scale, and that can help them achieve both earnings 
gains and welfare reductions. 

Finally, JOBS' extension of a participation requirement to women 
with younger children is another untested innovation. This population, 
which spans the full range of employability characteristics from very 
disadvantaged to job-ready, has been studied almost exclusively in 
programs for which they volunteer. Early evidence on programs for 
women with children 3 to 5 years old will come from the evaluations of 
Florida's Project Independence and the selective-voluntary Minority 
Female Single Parent Demonstration. 

• What are the effects of different processes for determining 
who gets which JOBS services and for managing the caseload? 

JOBS puts new emphasis on assessment as a means to match peo- 
ple to services. It also permits states to offer case management services. 
Past studies provide almost no guidance on the relative effectiveness of 
different approaches to matching clients to services and managing 
JOBS caseloads. 

Regarding assessment, almost all of the earlier broad-coverage pro- 
grams used a fixed service sequence that relied on a job search activity to 
determine which clients were immediately employable and which need- 
ed more intensive services. Only the Baltimore program employed an as- 
sessment approach and emphasized client choice. While the experience 
of selective-voluntary programs has the potential for illuminating the 
process of screening welfare recipients for a particular JOBS component, 
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these programs offer few lessons for a multi-component JOBS program. 
The "labor market screen" (i.e., up-front job search) approach of the 
broad-coverage programs has not been directly compared to the "up- 
front assessment" model, although choosing between these may be a 
key resource allocation decision for JOBS administrators. 

Welfare-to-work programs currently use a wide range of case 
managementapproaches.Insomelocalities,tasksassociated withassess- 
ing, assisting, motivating, monitoring, and brokering services for pro- 
gram participants have been divided between welfare agencies and 
other service providers and, within these agencies, between case man- 
agers and other staff. Alternatively, a single case manager may be 
responsible for eveiy aspect of participation for those assigned to him or 
her. Caseload si/es and the emphasis of case management activities - 
e.g., on counseling versus monitoring and enforcing participation - vary 
as well, and may affect program impacts. 

The studies of California's GAIN, Florida's Project Independence, 
Massachusetts' (Employment and Trair g) Choices, and New Jer- 
sey's Reali2:ing Economic Achievement (REACH) program should pro- 
vide initial information on the effects of JOBS-relevant program struc- 
tures and management approaches. The substantial share of JOBS 
resources that will probably be devoted to these activities and the central 
role given this function in some state programs highlight the importance 
of further understanding the cost-effectiveness of different case 
management strategies. 

♦ Are mandatory welfare-to-work programs more or less effec- 
tive than voluntary ones? 

Some people argue that mandatory programs are likely to have 
larger impacts than voluntary ones, primarilybecause they reach peof le 
who can benefit but would not opt to participate on their own ai d 
because they reach more people overall. Deterrence and sanctioning 
effects can also contribute to mandatory programs' impacts. Others 
claim that voluntary programs are likely to be more successful because 
they enroll people who are more predisposed to take advantage of 
services and who therefore attend activities more regularly, saving the 
program "compliance costs." Partly for this reason, 'hese people argue, 
voluntary programs are easier to administer. The JOBS legislation calls 
for states to give first consideration to volunteers among the program's 
target groups. But it allows for a participation mandate for the full 
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non-exempt caseload. As was also observed in the 1980s WIN and WIN 
Demonstration environment, states are implementing programs that 
run the gamut from all-volunteer programs to mandatory ones that pay 
a great deal of attention to compliance, with many programs arrayed 
between these poles. 

Unfortunately, past studies do not provide clear guidance on this 
design choice. The data for the broad -coverage programs in Table 1.1 sug- 
gest no evident relationship between either sanctioning or participation 
rates - both possible proxies for the extent to which a program was 
mandatory - and program impacts. There have been studies that found 
positive results for both broad-coverage mandatory and smaller volun- 
tary programs, but there are no rigorous studies that allow a direct 
comparison of the impact and cost-effectiveness of mandatory and 
voluntary broad-coverage programs or of programs that are more or less 
stringent in imposing program requirements. A comparison of the pattern 
of findings for SWIM (with its distinctive, strictly enforced continuous 
participation requirement, which began with job search) and Baltimore 
(with a much less mandatory design, which began with an assessment) 
may inform the mandatory/voluntary issue as well as the question of 
how to match people to services. Both programs had relatively large 
earnings impacts. SWIM had uncommonly large impacts on earnings 
and welfare payments, primarily driven by an increase in employment 
rates for the more disadvantaged two-thirds of the caseload. Baltimore, 
in contrast, was more likely to produce higher earnings (i.e., higher wa- 
ges or longer hours) for people who would have worked but earned less 
without the program. Baltimore's earnings impacts increased with time, 
while the program had little effect on welfare payments and did not 
generally benefit the more disadvantaged shar j of the caseload. 

If states are unable to meet the participation standards specified for 
JOBS programs in the law and implementing regulations, the choice of 
methods for encouraging program participation may rise to the top of 
the JOBS agenda. The question for administrators might then be: Can 
programs switch from voluntary to mandatory policies, or vice versa, 
and still achieve the desired impact results? 

• Whr^ works for the (usually male) participants from two- 
parent welfare families? 

As noted earlier, the JOBS legislation contains special provisions 
for the small segment of the welfare caseload in the AFDC-UP program, 
which call for involvement primarily in work programs, with an option 
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of education for young fathers who have not completed high school. 
They set eventual participation standards that are ii^uch higher than 
those for single parents. The dilemma administrators will face when 
these standards take effect between 1994 and 1998 is how to design 
programs tha^ are effective and meet the standards^ without targeting a 
disproportionate share of JOBS resources to AFIX-UP cases. Prior 
research is scanty and has not found effects for work-only models. 
However, SWlM's sequence of activities produced both earnings gains 
and welfare savings for AFEXI-UP recipients and the GAh\ evaluation 
will provide evidence on an education-oriented model. 

• What are ihe nature and duration of JOBS' economic and non- 
economic impacts on welfare recipients and their children? 

Underlying FSA are critical assumptions about the impact of partic- 
ular services on AFDC mothers and their children. The emphasis on 
education and other intensive services comes from a conviction that 
these are more likely to lead to better jobs, stable employment, and re- 
ductions in poverty, and thus to meet JOBS' goal of reducing long-term 
welfare dependence. The extension of JOBS' participation requirements 
to mothers of preschool children, FSA's extensive provisions for 
in-program and transitional child care, and the involvement of mothers 
in education programs that may improve not only skills but also 
self-esteem and parenting practices are based on an implicit assumption 
that a mother's participation in JOBS and subsequent employment can 
have a positive effect, or at least not a negative effect, on her children. 

Testing these assumptions will require that data from future studies 
go beyond those collected for prior ones. Information on a wider range 
of outcomes will be essential, including (for AFDC parents) wages and 
job quality, educational achievement, family income and povt^rty, fam- 
ily functioning and parenting, and health status, and (for the children of 
JOBSenrollees) cognitive, social, emotional, and physical development. 
Knowledge about this wide range of outcomes will sharpen policy- 
makers' understanding of how JOBS progrt^ms achieve their effects. 

Future studies will also need to follow people for longer periods. 
The completed studies showed that the impacts of low-cost services start 
quickly and last for at least the three years measured in some studies, 
while those of more intensive services start more slowly and last for at 
least the same period. To quantify the trade-off between different JOBS 
approaches, follow-up data will be needed that are adequate to deter- 
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mine whether larger investments deliver greater long-term benefits, to 
measure changes in the impacts of high- and lov^-cost services over 
time, and to estimate the effects of JOBS on the average length of stay on 
welfare and on the rate at which people who leave welfare subse- 
quently return to the rolls. 

• Will JOBS programs be able to achieve the scale needed to 
meet participation standards and yet maintain the successes 
demonstrated in smaller or simpler pre-JOBS models? Will 
the results of JOBS programs depend on the strength of local 
labor markets? 

There are numerous open feasibility questions for JOBS that also 
have implications for program impacts. For example, while most of the 
broad-coverage evaluations examined large-scale programs in real- 
world conditions, the JOBS legislation - if implemented as envisioned - 
would increase program scale. It is not clear whether the measured 
impacts of these earlier programs would be replicated if the approaches 
studied are expanded and extended to a much greater share of the case- 
load. Similarly, when JOBS programs utilize components that resem- 
ble those tested in selective-voluntary demonstrations, but at a larger 
scale, it will be important to see whether the same results are achieved, 
and how these components function within broad-coverage programs. 
Finally, JOBS programs that involve multiple components, numerous 
decision points, and coordination among many agencies will face formi- 
dable management challenges: 1 i i . y will have to work very hard to route 
clients to the correct component, and to keep clients from dropping out 
between components and between agencies. These implementation 
problems multiply the difficulty of managing the JOBS caseload; they 
can also lead to delays and reduced participation levels. Few program 
operators have much experience with these complex management is- 
sues; thus, the feasibility of the new programs is yet to be determined. 

A related unanswered question is the extent to which the effective- 
ness of JOBS - particularly when it is operated at large scale- will depend 
on local and na^^onal economic conditions. Positive evrluation results in 
sites with a range of unemployment levels and other labor market 
characteristics (but not confronting highly depressed local economies) 
suggest that these programs can have impacts in relatively strong or 
weak labor markets and in improving or deteriorating economic con- 
texts. However, the West Virginia study suggested that welfare-to-work 
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initiatives may not succeed in rural areas with very weak labor markets. 
Extreme cyclical variations in the economy may also af/ect the size of 
program impacts or the relative effectiveness of different JOBS ap- 
proaches in ways that are currently unknown. 

The JOBS legislation's call for specific participation levels suggests 
that these programs will be larger than those in past stud ies and also rais- 
es other issues. The participation targets are elaborated by regulations 
that focus on the hours of activity by JOBS participants. The legislation 
also calls for future outcome-based performance standards. While the 
WIN and Job Training Partnership Act experiences suggest both the 
power of focusing staff on performance outcomes and the importance of 
doing it in a way that supports program goals, it is not at all clear how 
these issues will play out in JOBS. Past research points to some of the 
challenges in designing JOBS' performance standards, but further study 
is important for understanding the feasibility and impact of alternative 
approaches. 

• What are the impact and cost«-effectiveness of child care and 
Medicaid benefits that are provided to welfare recipients 
who leave the rolls to work? What are the effects of differ- 
ent administrative and funding arrangements for in-program 
child care? 

The impact of subsidized child care on participation in 
welfare-to-work services and on subsequent employment have not yet 
been measured. This is true of both in-program child care and that of- 
fered a3 a transitional, or post-program, service. Expenditures on child 
care are certain to rise under JOBS; consequently, information on the 
kinds of child care arrangements and subsidy levels that will contribute 
to the effectiveness of welfare-to-work programs will be particularly 
valuable. A few current studies - including an especially relevant one 
(the Expanded Child Care Options Demonstration) that compares the 
impacts of three levels of child care funding - will partially address these 
questions. Other issues regarding the relationship between child care 
and work for welfare recipients will require a range of research designs. 

Regarding the transitional child care and Medicaid provided for in 
FSA, key questions include: What is the take-up rate for these services? 
Do they help people enter employment, increase job stability and reten- 
tion, and reduce the rateat which people return to welfare? Do they boost 
the impacts of either low-cost ''labor market attachment" or higher-cost 
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"human capital investment program models, or both? Do they change 
the relative cost-effectiveness of different JOBS approaches, e.g., of pro- 
grams that tend to place people in lov^er- or liigher-wage jobs? The chal- 
lenge facing future studies that focus on transitional benefits and child 
care is to expand the knowledge base in ways that are useful to states 
seeking to improve the quality and effectiveness of their JOBS programs. 

During the past 15 years, state and federal policymakers, founda- 
tions, and community-based service providers made a remarkable 
commitment to learning in a systematic and rigorous wa^ 'hether 
different approaches could be effective in increasing the self-sufficiency 
of single parents on welfare. This produced a substantial body of experi- 
ence and knowledge on which JOBS is already building. 

While JOBS administrators can benefit from the past, their tasks 
are no less formidable than those faced by people who designed and 
implemented the initiatives of the last decade, i he challenges, however, 
are different. In the 1980s, the goal was to learn whether investments in 
welfare-to-work programs had a clear payoff. This threshold question 
has been answered. The challenge for JOBS - both for those wrestling 
with the key operational issues and for researchers - is to do better: to 
improve on the performance of past programs and to advance the state 
of knowledge. 

The JOBS legislation embodies lessons from the past, but it also 
reflects optimism about untried ways to achieve results that go beyond 
the accomplishments of the first round of welfare-to-work programs. 
The research planned for JOBS, and the large number of relevant stud- 
ies already under way, can inform the choices JOBS administrators will 
face in the years to come as they apply their experience and program 
designs to the new vision of welfare reform. 
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Sources for Table 1.1 

AFDC Homemaker-Home Health Aide Demonstrations 

Bell Stephen H.; Enns, John H.; and Orr, Larry L. 1986. 'The Effects of Job Training and 
Employment on the Earnings and Public Benefits of A¥DC Recipients: The AFEXZ 
Homemaker-Home Health Aide Demonstrations." Draft. Paper presented at the 
Annual Research Conference of the Association for Public Policy Analysis and 
Management, Austin, Texas. 

Orr, Larry L. 1987. Evaluation of the AFDC Homewaker Howe Health Aide Demonstrations: 
Benefits and Costs, Cambridge, Mass.: Abt Associates Inc. 

Arkansas WORK Program 

Friedlander, Daniel; and Goldman, Barbara. i988. Employment and Welfare Impacts of the 
Arkansas WORK Proj^ram: A Three-Year Folloio-Up Study in Two Counties. New York: 
MDRC. 

Friedlander, Daniel; Hcwz, Gregory; Quint, Janet; and Riccio, James. 1985b. Arkansas: Final 
Report on the WORK Program in Two Counties, New York: MDRC. 

Baltimore Options I'rogram 

Friedlander, Daniel. 1987. Maryland: Supplemental Repwrt on the Baltimore Options Program. 
New York: MDRC. 

Friedlander, Daniel; Hoer/, Gregory; Li>ng, David; and Quint, Janet. 1985a. Maryland: 
Final Report on the Employment Initiatives Evaluation. New York; MDRC. 

Cook County WIN Demonstration 

Friedlander, Daniel; Freedman, Stephen; Hamilton, Gayle; and Quint, Janet. 1987. Illinois: 
Final Report on Job Search and Work E.xperience in Cook County. New York: MDRC. 

Louisville WIN Laboratory Experiments (Group and Individual Job Search) 
Goldman, Barbara. 1981 . Impacts of the Immediate job Search Assistance Experiment. New Y.7 r'^ : 
MDRC. 

Wolfhagen, Carl. 1983. Job Search Strategies: Lessons from the Louisville WIN Laboratory. New 
York: MDRC. 

Maine On-the-job Training (OJT) Program 

Auspos, Patricia; Cave, George; and Long, David. 1988. Maine: Final Report on the Training 
Opportunities in the Private Sector Program. New York: MDRC. 

National Supported Work Demonstration 

Grossman, Jean Baldwin; Maynard, Rebecca; and Roberts, Judith. 1985. Reanalysis of the 

Effects of Selected Employment and Training Programs for Welfare Recipients. Princeton, 

N.J.: Mathematica Policy Research, Inc. 
Hollister, Robinson G., Jr.; Kemper, Peter; and Maynard, Rebecca A., eds. 1984. The National 

Suppijrted Work Demonstration. Madison, Wis.: University of Wisconsin Press. 
Kemper, Peter; lA>ng, David A.; and Thornton, Craig. 1981 . Th Supiwrted Work Evaluation: 

Final Benefit-Cost Analysis. Princeton, N.J.: Mathematica Policy Research, Inc. 

New Jersey On-the-job Training (OJT) Program 

Freedman, Stephen; Bryant, Jan; and Cave, George. 1988. Neio jersey: Final Report on the 
Grant Diversion Project. New York: MDRC. 
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SanDiegoUEmploymentPreparationPiogiam/ExpcrimenlalWorkExperience Program 
lEPP/EWBPI) 

Goldman, Barbara; Friedlander, Daniel; and l^ng, David. 1986. Caiifontin: Final Report on 
the San Diego Job Search and Work Experience Demonstration. New York: MDRC. 

San Diego Saturation Work Initiative Model (SWIM) 

Hamilton, Gay le; and Friedlander, Daniel. 1989. Final Report on the Saturation Work Initiative 
Model in San Diego, New York: MDRC. 

Virginia Employment Services Program (ESP) 

Friedlander, Daniel. 1988a. "An Analysis of Extended FoUow-Up for the Virginia Em- 
ployment Services Program." Unpublished internal document. New York: MDRC. 

Riccio, James; Cave, George; Freedman, Stephen; and Price, M.mlyn. 1986. Virginia: 
Final Report on the Employment Services Program. New York: MDRC. 

West Virginia Community Work Experience Program (CWEP) 

Friedlander, Daniel; Erickson, Marjorie; Hamilton, Gayle; and Knox, Virginia. 1986. We^t 
Virginia: Final Report on the Community Work Experience Demoni>tration$. New York: 
MDRC. 
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The Context for Evaluating 
Welfare-to-Work Programs 



In analyzing research relevant to JOBS, it is important to identify what is 
distinctive about the JOBS approach and to understand the factors and 
program dimensions that potentially can affect program impacts. To 
address these two issues, the chapter begins with a brief review of the 
evolution of welfare-to-work programs, the new features contained in 
the JOBS legislation, and the context of federalism in which JOBS will be 
implemented. This is followed by the presentation of a framework or 
conceptual structure for summarizing how different features of JOBS 
and the local context can influence the behavior of AFDC recipients and 
affect program impacts. The chapter ends with a discussion of some of 
the challenges this framework implies for determining the impacts of 
different welfare- to- work approaches. 

The Evolution and Distinctiveness of JOBS 

From Welfare to Work 

This country's 25-year welfare reform debate reflects widespread 
dissatisfaction with the design of the nation's public assistance system 
and its ability to solve fundamental problems of poverty and depen- 
dence. Aid to Dependent Children (ADC) - subsequently replaced by 
Aid to Families with Dependent Children (AFDC) - was enacted as part 
of the Social Security Act of 1935 to provide for the needs of poor chil- 
dren in single-parent households. The program was expected to be small, 
and its goal was to provide poor widows with the opportunity to stay at 
home and care for their child ren in accordance with prevailing norms for 
women. 

Since the 1930s, however, a number of developments have prompt- 
ed discontent with the program. First, close to 90 percent of AFDC cases 
are now headed not by widows but by mothers who are separated or di- 
vorced or were never married; welfare for families with absent fathers 
who are not supporting them has never been popular. Second, enthusi- 
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asm for the welfare system has been eroded further by the change in 
women's work patterns. In recent years, employment rates for all women 
- including single parents and women with very young children - have 
increased dramatically. With the majority of mothers working at least 
part-time and often from economic necessity, it became difficult to 
defend the equity of supporting a sizable number of poor mothers who 
are not employed. This is particularly true since research does not show 
any clear link between a mother's employment status and the well-being 
of her children.* Third, contrary to original expectations, AFDC case- 
loads and costs grew rapidly in the 1960s and early 1970s. 

Finally, although recent research confirms that most people use 
welfare for only short-term support, it also identifies a substantial 
minority who remain poor and receive assistance for very long periods 
and consume a disproportionate share of welfare expenditures (Bane 
and Ellwood, 1983; Ellwood, 1986). The current debate has focused on 
these families because of both the high cost of supporting them and the 
assumed negative effects of long-term welfare receipt on these mothers 
and their children. 

In addressing these concerns, federal reform efforts - culminating in 
the Family Support Act - have reflected increasing support for a differ- 
ent view of public and individual responsibilities. The key elements are 
that parents should be the primary supporters of their children and that 
government should provide incentives and assistance to welfare recip- 
ients to find employment. This has meant greater enforcement of child 
support collections from absent fathers and new obligations on welfare 
mothers to cooperate with such efforts. It has also meant requiring 
mothers to take a job or participate in activities designed to enhance their 
employability, and a renewed emphasis on the government's respon- 
sibility to assist them in this process. 



^SeeGarfinkel and McLanahan, 1986; Wilson and EllwtK)d, 1989; BriHjks-Cunn, 1989. For 
example, Garfinkel and McLanahan, 1986, report that, while some negative effects on 
adolescents have been associated with maternal employment, positive effects on younger 
children have also been found. For the most part, these positive effects disappear when 
income is taken into account, suggesting that higher income (rather than the mother's 
working) may be the reason for the beneficial effects. They also point to studie^= that sug- 
gest a possible "modeling effect," i.e., the mother's employment can affect the career aspi- 
rations of older daughters. In summarizing their review of research in this area, they con- 
clude: "At present we cannot say with certamty that the mother's working has no negative 
consequences for children. However, there is good reason to believe that the effects on 
children of prescht)ol and elementary school age are neutral to p<>sitive. The . . . negative 
effects for high school sophomores and seniors, however, make this less certain for 
adolescents" (p. 37). 
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Since 1971, state Work Incentive (WIN) programs have explicitly 
required adults in single-parent (usually female-headed) AFDC 
households without preschool-age children or specific problems that 
keep them at home - and one adult (usually the male) in turo-parent 
AFDC-UP (Unemployed Parent) families - to register and participate in 
a v^elfare-to-work program or risk grant reductions or termination. 
After WIN's initial years, its emphasis shifted to direct job place- 
ment.^ Hourever, because of administrative issues and resource 
constraints, participation was often limited to registering welfare re- 
cipients without actually involving them in program activities. The 
program lost credibility is it failed to meet its operational objectives 
and could provide nc -liable evidence of cost-effectiveness. 

Congressional action in the early 1980s gave states new flexibility 
in assisting and requiring welfare recipients to work. States could man- 
date Community Work Experience Programs (CWEP) - where people 
would work in exchange for their welfare benefits in what are often called 
"workfare" positions - or expand job search requirements. Under the 
WIN Demonstration provisions, they crnld end dual agency oversight 
and shift full responsibility for adm^ ustration to the welfare agency. 
Despite simultaneous sharp funding cutbacks, these changes increased 
state ownership, prompting a number of states and localities to imple- 
ment innovative programs and breathing new life into a scaled-down 
WIN program. During the early and mid-1980s, almost all of the states 
picked up on at least one of the new provisions, implementing pro- 
grams that were usually low- or moderate-cost and that imposed short- 
term job search or workfare requirements on part of the caseload. 
Usually, this was limited to some or all adults in two-parent house- 
holds and single parents with school-age children, and to only certain 
areas of the stale. (See U.S. Congressional Budget Office, 1987; U.S. 
General Accounting Office, 1987b; Nightingale and Burbridge, 1987.) 

More recently, a number of states have instituted more far-reaching 
changes. Some states, such as Massachusetts in its Employment and 
Training (ET) Choices program and Washington in its Family 
Independence Program (HP), have emphasized voluntary participation 
and offered welfare recipients a choice of services. Others, such as 



For a summary of thi? history of tho WIN program, its modification by the provisions of the 
C)mnibus Budget Reconciliation Act of 1 981 , and congressiona I actionson work requirements 
in the AFDC program, see Malone, 1986; U.S. Congressional Budget Office, 1987; Mead, 
1986; Rein, 1982. 
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California in its Greater Avenues for Independence (GAIN) program, 
adopted in 1985, require mandatory up-front education for many. Still 
others, such as New Jersey in the Realizing Economic Achievement 
(REACH) program, started in 1987, have required participation based 
on the results of an assessment and have included mothers with younger 
children. Thus, flexibility, decentralization, and reduced funding 
transformed WIN by the late 1980s from the relatively uniform federal 
program of the 1970s to state initiatives of varied cost, coverage, design, 
and goals. 

Disenchantment with the AFEX? program and concern about the 
high rate of poverty among children, combined with the widely accept- 
ed evidence from studies on the cost-effectiveness of state initiatives, 
built support for expanding welfare-to-work programs. While there ap- 
peared to be agreement on the underlying concept of a reciprocal obliga- 
tion between the AFDC recipient and the state, this masked continued 
disagreement over the goal, and thus the tools, of reform. Some argued 
that welfare recipients want to work but lack the education and skills to 
obtain jobs that assure self-sufficiency and a decent standard of living. 
They saw reductions in poverty as the primary reform goal and favored 
programs that serve volunteers first, offer choices, provide education 
and training, and do not require people to take low-wage jobs. Others ar- 
gued that jobs were available and believed that welfare recipients were 
either unwilling to work or loo discouraged to try. They saw reducing 
welfare dependence as the primary objective and favored programs 
that set clear expectations, require participation for those not already 
employed, provide low-cost job placement assistance rather than 
expensive training, and mandate workfare for those who remain on 
the rolls. 

The JOBS Program 

JOBS ~ the centerpiece of FSA - replaces the Title IV-C (WIN) and 
Title IV-A work programs authorized by the Social Security Act with a 
newly expanded and consolidated welfare-to-work program, JOBS al- 
lows states flexibility in designing future initiatives but establishes man- 
dates and incentives to move statr programs in new directions. JOBS 
goes substantially beyond WIN in its emphasis on education; in extend- 
ing a participation mandate to women with no children under age 3 (age 
1 atstate option); in instituting a school requirement for young custodial 
parents; in setting minimum participation standards; in emphasizing 
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service to potential long-term welfare recipients; and in its funding, 
under another title of FSA, for child care.^ JOBS thus seeks to reduce wel- 
fare receipt through elements of both views of welfare reform: participa- 
tion mandates, strengthened work incentives and supports, and 
investments to improve the capacity of AFDC mothers to obtain jobs and 
possible self-sufficiency. 

The complex funding structure and the many - sometimes contra- 
dictory - visions within JOBS mean that future programs are likely to 
vary substantially across states. States can be expected to choose both 
different program designs within the framework of JOBS requirements 
and different levels of investment in JOBS, since the law states that many 
requirements are to be met "to the extent that resources permit." For 
AFDC recipients, the key features of JOBS include: 

• Services. States have flexibility in program design but must 
provide educational activities (high school education and /or its 
equivalent, basic and remedial education, and education in 
English as a second language lESL]); job-readiness activities 
(including pre-employment training in job skills); job skills 
training (training in technical job skills); and job development 
and job placement. They must also offer at least two of the 
following: group and individual job search, on-the-job training 
(OJT), work supplementation (grant-diversion-funded OJT), 
and community work experience or other work experience. JOBS 
gives states an option to allow participation in self-initiated 
education or training at a post-secondary institution or voca- 
tional or technical school. 

The JOBS statute emphasizes education by requiring that it be 
offered to any adult JOBS participant who lacks a high school 
diploma or does not d^^monstrate basic literacy, unless the 
employability plan for the individual identifies a long-term 
employment goal that does not require a high school diploma 
(or its equivalent). (To support the education requirement, JOBS 
provides federal funding for certain educational activities.) 



' Key non-JOBS provisions of FSA strengthen child support enforcement, authorize funding 
for in-progr.im child care for JOBS participants, require states to provide benefits to 
unemployed parents, and provide for a year of transitional child care and Medicaid for 
individuals leaving welfare for employment. 
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However, the program-design flexibility granted states by the 
statute suggests that they will differ in their emphasis on dif- 
ferent components, including education, and the sequence of 
activities. JOBS promotes intensive services, particularly be- 
cause the regulations define program participation based on 
the number of individuals who, on average, participate in activ- 
ities scheduled for 20 hours per week. (States may count indi- 
viduals in programs with more and less than this number of 
hours to reach the 20-hour average.) 

JOBS also introduces a new requirement that, with few 
exceptions, custodial parents under age 20 who have not 
completed high school or its equivalent must participate in an 
educational activity or risk having their welfare benefits re- 
duced (the ''learnfare" provision). 

• Targeting. The JOBS legislation contracts the definition of who 
is exempt from participation in wel fare-to- work activities, 
thereby extending the coverage of these activities to AFEK^ 
applicants and recipients who have children 3 to 5 years of age 
(1 to 5 years of age at state option) and who are not otherwise 
exempt. To avoid a reduction in federal matching funds, states 
must spend at least 55 percent of JOBS funds on families in 
which the custodial parent is under age 24 and has no high 
school diploma (or equivalency) or has had little or no work in 
the last year, the youngest child is within 2 years of ineligibility 
for AFDC, or the family received AFDC during 36 of the prior 
60 months. 

• Management Monitoring, and Mandatoriness. JOBS requires; 
that states conduct an initial assessment (the form is not speci- 
fied, and it may follow a brief job search) and develop an em- 
ployability plan. It gives them an option to develop a case 
management system. While JOBS specifies that the welfare 
agency take overall responsibility for the program, the agency 
may subcontract for a wide range of activities and is required 
to coordinate with the Job Training Partnership Act (JTPA) 
and education systems. 

While JOBS requires participation, and sets monthly participa- 
tion standards, which increase from 7 to 20 percent over time, it 
calls on states to give first consideration, in determining prior- 
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ity for services, to those people within the JOBS target groups 
who volunteer to participate. 

• Support Services. To mandate participation in JOBS, states must 
provide child care and pay for transportation and other expens- 
es. A separate title of the Family Support Act (Title III) allocates 
funds for in-program care for participants' children. Child care 
purchased for JOBS participants must meet applicable stan- 
dards of state and local law, and states must coordinate JOBS 
child care with early childhood education programs. 

In addition, FSA requires that all states provide cash assistance to 
AFDC-UP (two-parent) families as of October 1, 1990. While states that 
had an AFDC-UP program as of September 26, 1988, must continue 
operating programs that provide benefits for 12 months per year, other 
states can choose to limit AFDC-UP benefits to as few as 6 months in any 
12-month period. Tied to this, JOBS establishes special participation rates 
for parents in AFDC-UP families, which increase from 40 percent in 1994 
to 75 percent by 1998. The state must require at least one parent in the 
family to participate in one of the following: a work supplementation 
program, community work experience, on-the-job training, or a 
state-designed work program approved by the Secretary of Health and 
Human Services; for parents under age 25 who have not completed 
high school or its equivalent, the state may require participation in an 
educational activity directed toward that end. In most cases, the par- 
ent(s) must participate for at le..st 16 hours per week; however, in states 
thatchooseto requiroeducationforAFEXT-UPparentswhoare underage 
25 and lack a high school or equivalent education, individuals will be 
considered as meeting participation requirements if ihey make satisfac- 
tory educational progress. 

The new features of JOBS simultaneously push states in two direc- 
tions. The emphasis on human capital development, intensive weekly 
participation, and the importance of investing to increase the employ- 
ability of long-term recipients suggest more expensive services. The 
establishment of monthly participation standards and the extension of 
a participation mandate to a much-enlarged share of the AFDC case- 
load suggest serving more people. Combined, these encourage states 
to develop more complex programs than the job search/work experi- 
ence sequence typical of the early and mid-1980s. 

States will be designing JOBS programs in response to the regula- 
tions, state and local conditions and resources, and their existing welfare- 
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to-work programs. Because of the highly varied experience of the 1980s, 
states will be launching JOBS from very different positions: Some have 
virtually no program in place and very limited likely state (and thus 
federal) funds; others have already made major investments in JOBS-like 
programs and are committed to a particular model and service delivery 
strategy. JOBS is less a single federal "program" than a federal/state 
partnership. The law establishes a set of incentives (i .e., enhanced federal 
funding) and requirements that encourage states to move in particular 
directions, but states will probably respond very differently. It is hard to 
predict the extent to which JOBS will be broad-coverage and mandato- 
ry, reach long-term welfare recipients and young mothers, and in fact 
change the tone and message of the welfare system. The most likely sce- 
nario is great cross-state variation in the cost, quality, and type of ser- 
vices; the extent and nature of coordinationacrossmajor delivery systems; 
the form of assessment and case management; the extent to which partic- 
ipation is mandatory or voluntary for different groups in the caseload; 
the scale of the program; and the reality of educational innovation. The 
most critical uncertainty is the likely state response to the JOBS funding 
incentives. FSA establishes the maximum federal matching funds avail- 
able to states. To draw down these funds, states must commit substantial 
resources of their own, and at an overall less favorable matching rate 
than that required under the earlier WIN program. The scale of the JOBS 
program will, therefore, depend on the response of state legislatures, 
acting at a time when many face large budget deficits and simul- 
taneous pressure to fund other priorities, including several other 
provisions of FSA. 

The early JOBS experience confirms the variation and the shift in 
focus, as well as the funding uncertainties. States are replacing the 
relatively simple programs of the 1980s with more complex initiatives 
that place greater emphasis on assessing service needs, offering choices, 
using counseling and case management, focusing on those who volun- 
teer, reaching long-term recipients, and providing education and train- 
ing (usually through coordination with the education and JTPA 
systems)."* Many states are also experiencing budget deficits that are 
threatening the scale of their new JOBS programs.'' 



Scf, e.g., American Public Wt'lfaru AsMKiation, 1991). 

''A study of early JOBS implementation (American Public Welfare AssiKiation, IWO) 
indicates that statts are not putting up the funds required tor them to receive their full 
alkKations of federal JOBS funds (their "capped entitlement"). 
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A Framework for Understanding the Effects 
of State JOBS Programs 

On the surface, the basic approach of welfare-to-work programs 
would seem to be simple and direct: Increase participants' employment 
and earnings and thereby reduce welfare receipt and expenditures. In 
fact, many forces shape employment and welfare behavior, making 
successful intervention a complex challenge. This section lays out a 
framework that is used in the rest of this synthesis for understanding the 
ways in which \vel fare-to- work programs can affect behavior and for 
discussing past research designs and findings. 

Our starting point is to group the forces shaping program 
implementation and impacts into two categories: (1) those defining the 
external context in which the program intervention is implemented, 
which determine the underlying pattern of welfare dynamics, and (2) 
those defining the nature and strength of the program intervention. 

Tu'i extensive recent research on welfare caseload dynamics (Bane 
and Ellwood, 1983; EUwood, 1986) provides a critical background for 
understanding past studies and assessing the impact of wel fare-to- work 
programs. Any effort to reduce welfare receiptand increase self-sufficien- 
cy must start with a recognition that many people leave welfare ~ some 
to employment - wiih no program assistance. The underlying pattern of 
welfare dynamics (including the usual length of welfare receipt, case- 
load turnover, and case reopenings or recidivism owing to a return to 
welfare) is represented by the behavior of the control group in the impact 
analyses of welfare-to-work programs. Bane and Ellwood's work has 
highlighted the fact that moi:t people receive public assistance for a 
relatively short time, while a smaller group receives assistance continu- 
ously for an extended period. The JOBS legislation reflects the implica- 
tions of this research in its emphasis on targeting certain subgroups of 
AFDC recipients in an effort to reduce long-tt rm dependence. 

The nature and strength of the program intervention determine the 
extent to which the labor market, income, and family experiences of 
those in the experimental group rise above the base level represented by 
the control group. Program impacts are estimated by comparing the 
experiences of controls (who do not receive services from the wel- 
fare-to-work program) to those of experimentals (who are served by the 
program). This framework for understanding the determinants of pro- 
gram impacts is summarized in Figure 2.1. 
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Contextual f actors That Affect the Underlying 
Pattern of Welfare Dynamics 

Past research and experience have identified several key contextual 
factors that influence v/elfare dynamics. 

Labor Market Conditions and Area Characteristics. Labor market 
conditions influence v/elfare dynamics in two ways: They affect the 
ability of recipients to find work and leave w elfare, and they also more 
subtly influence the characteristics of the remaining public assistance 
caseload. When labor demand is strong, relatively job-ready individuals 
~ who might apply for welfare in a poor economy - may find employment 
and never receive public assistance, or,if they do become recipients, they 
may leave the rolls more rapidly. Thus, a strong labor market will result 
in a less job-ready caseload, although its effect on program impacts is less 
certain.^ 

Characteristics of the AFDC Population. A number of studies have 
used national data to identify characteristics that help predict duration 
of AFDC receipt (Bane and EUwood, 1983; O'Neill et al., 1984; Ellwood, 
1986; Maynard et al., 1986)7 This research has found several characteris- 
tics to be associated with longer welfare receipt: Marital status, race, 
work experience, education, mother's age, and the age of the youngest 
child are important predictors of the likely duration of v/elfare receipt.^ 
For example, mothers with younger children are likely to have longer 
stays on welfare and increased repeat spells. Lower levels of education 
were also found to be associated with longer AFDC receipt. A negative 
relationship was also found between extent of work experience and 
probability of greater welfare dependence. 

This research (Ellwood, 1986) also identified a gioup most likely to 
become long-term recipients: young women who have never been mar- 
ried and who begin to receive assistance when their child is less than 3 
years old. Over 40 percent of this group will receive welfare for ten years 
or more. Dividing the wrelfare population by race, work experience, and 
education has been found to yield other important subgroups. 



^•e, e.g., the discussion in Goldman, Friedhindcr, and Long, 1986. 

'^Sc^* Interagency low Income OpfM)rtunity Advisory Board, Executive Office of the Presi- 
dent, 1988, for a useful summary of this research. 

"rht^se correlations are calculated with other characteristics not held constant. Since 
targeting strategies for vjgrams would identify individuals by a few simple characteristics 
with other characteristics not held constant, this concept of correlation is the relevant one 
for this discussion. (See Ellwood, 1986.) 
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Recent evaluations of state welfare-to-work programs support these 
conclusions. For controls, length of prior welfare receipt, prior earnings, 
and educational attainment all were important predictors of long-term 
welfare receipt (Friedlander, 1988b). 

Characteristics of the AFDC Program. State AFDC grant levels af- 
fect welfaredynamicsand program impacts by influencing the character- 
istics of the progiam-eligible population and the relationship between 
employment and welfare receipt. At low grant levels, AFDC recipients 
tend to be more disadvantaged than those of similar-size families receiv- 
ing higher grants. In addition, with low grants, even modest earnings 
lead to case closure, whereas people can combine work and welfare more 
easily in high-grant states. FinaMy, differences in the design and grant 
levels of state programs for two-parent households can be expected to 
affect the characteristics and turnover of the AFDC-UP caseload. 

Other elements of the A¥DC program, such as the FSA provisions 
offering a year of transitional Medicaid and child care to people who 
leave welfare for a job, may also affect welfare dynamics by making it 
more or V )s attractive to apply for (or to leave) welfare. Factors in the 
welfare-to-work program itself may similarly influence AFDC entry and 
exit rates by changing the climate for welfare receipt: e.g., reducing or 
increasing the stigma associated with welfare, or changing the perceived 
total benefit package. Recent studies have not focused on estimating 
entry effects, but instead on determining whether the programs nave 
impacts of any magnitude on those who apply for AFDC, which would 
appear to be a precondition to their attracting substantial numbers of 
additional applicants."^ 

Existing Community Employment and Training Services. The 
existence of employment-related services that are separate from the 
welfare-to-work program also influences welfare dynamics. Some 
communities have a wide array of organizations providing education, 
training, job search assistance, and other employment services which 
will presumably benefit everybody in thearea, including members of the 
control group. One of the surprising findings in studies of 198Us 
welfare-to-work programs was the high rate of self-initiated participa- 
tion in these types of community programs by members of the experi- 
mental and control groups. 

^An exception is the non-experimental study by O'Moill, 199(), which sought to capture 
both entry and exit effects in estimating the impact of Massachusetts' welfare-to-work 
program on the size of the welfare caseload. 
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Existing Community Support Services. The availability and quality 
of child care and other support services can affect participation in 
employment-related programs, work patterns, and, hence, welfare 
dynamics* 

Factors Defining the Nature and Strength 
of Welfare-to-Work Interventions 

Seven factors, shown in the right-hand box of Figure 2.1, are likely to 
shape the strength or effectiveness of the welfare-to-work intervention. 
Thesedimensions-someof which reflectdifferentprogramphilosophies 
and competing claims for resources - represent the major choices facing 
states as they design welfare-to-work programs. While these factors are 
discussed separately, specific state programs will be multi-dimensional, 
reflecting decisions in each of these areas. Together, these will determine 
participation rates, the nature and quality of employment and support 
services, and possible deterrence to continued welfare receipt - all of 
which, when combined with the contextual factors, will affect outcomes 
for people targeted to receive JOBS services (the experimental group) 
and through this determine the program's net impact. (See Figure 2.1 .) A 
primary task of this synthesis is explaining what is currently known- 
and likely to be learned from funded studies - about the importance of 
each of thef^e factors; that is, about what works best for whom. 

Funding for the Program . While states face a theoretical requirement 
to serve all adult recipients with children 3 years of age or older, budget 
constraints suggest that no state will have the resources to provide 
comprehensive (or even low-cost) services to everyone in this group. The 
level of available funding will strongly influence the number of people 
served and the intensity of services (including employment-directed 
services, support services, and oversight and case management). 
Regardless of the size of their budgets, program administrators will 
have three potential responses. In simplified terms, they are: 

• Option 1: Operating a program that emphasizes low-cost ser- 
vices (primarily job search assistance) for a large proportion of 
the caseload. 

• Option 2: Targeting more intensive, higher-cost components 
and case management on a smaller, more narrowly defined 
group and leaving the rest unserved. 
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• Option 3: Designing a mixed strategy, with low-cost services for 
certain groups and higher-cost services for others, that reaches a 
share of the caseload in between the other two options. 

Consequently, the amount of funds available will play an important role 
in determining how a jOBS program plan is translated into participation 
in substantial employment-related services for a significant portion of the 
caseload. 

Program Model. The design of state welfare-to-work programs will 
reflect available resources and an underlying implicit focus on certain 
presumed causes of welfare receipt, with a resulting recommendation of 
certain types and ordering of services. Program approaches will differ in 
program goals (e.g., the relative emphasis on reducing welfare receipt or 
increasing earnings and reducing povorty), services provided (e.g., job 
search, community work experience, education, or training), techniques 
used to deliver these services, and the sequence and duration of activities. 

Other Community Employment and Training Services. Within any 
given WIN or JOBS budget, more AFDC recipients can be served and 
more intensive activities provided in communities where there are many 
other independently funded education and training services and 
well-developed interagency coordination. In this situation, welfare 
agencies can refer recipients to the appropriate agency, monitor their 
progress once referred, and arrange new placements if the initial service 
plan does not prove satisfactory. 

For this reason, the budget trade-off is more complex than suggested 
in the section on ''Funding for the Program." All JOBS expenses will 
not in fact compete for the same budget dollars. Some services (e.g., 
case management) will typically be paid for directly with JOBS funds, 
while others will be funded by other delivery systems. The legislation's 
emphasis on coordination across the welfare, job training, and education 
systems means that the welfare agency's real budget constraint depends 
to an important extent on the services provided by these other agen- 
cies. This is particularly the case for education, since services provided 
by local school districts, regional vocational-technical centers, and 
community colleges may limit the costs paid by JOBS, making this the 
intensive service that can most feasibly be provided to substantial num- 
bers of enrollees. 

Community Support Services. FSA guarantees child careforall pro- 
gram-eligibles who need it in order to participate in approved activities 
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(unless their children are age 13 or over). Further, no one can be required 
to participate in such programs unless child care is available. Thus, the 
availability and quality of child care in the community assume special 
importance, and serious supply constraints could lower participation 
and hence program impacts. 

The Degree of ''Mandatoriness'' of the Program. Participation in 
program activities can be voluntary or mandatory, with the choice 
reflecting basic differences in states' assumptions about the causes of 
poverty and thus appropriate program approaches. (See the discussion 
of program philosophies in the first section of this chapter, 'The Evolu- 
tion and Distinctiveness of JOBS.") Mandatory programs will probably 
draw participants with a wider range of "job-readiness" than would vol- 
untary programs, though the evidence is unclear . In addition, mandatory 
programs can have impacts on people who never participate in required 
activities if they change their behavior to avoid the increased "hassle 
cost" of the program requirement: Individuals may leave welfare or 
never apply (i.e., be deterred), or they may initiate education, training, 
job search, or employment on their own outside the program, anticipat- 
ing that a participation requirement will soon be applied to them. Still 
others may be sanctioned for failure to comply with participation 
requirements. The impacts of voluntary programs, on the other hand, 
are primarily limited to those who participate in program activities. 

Prior research suggests that mandatory and voluntary labels obscure 
great variation in the extent to which a participation requirement is 
actually enforced and in the nature of the mandate. The degree to which 
a program was, in practice, mandatory depended on procedures for 
granting exemptions and deferrals and on the extent to which staff 
followed up on and, ultimately, sanctioned people for noncompliance.^" 
Under JOBS, this distinction is likely to be even more complex than un- 
der WIN, since the Family Support Act leaves up to states the question 
of how much emphasis should be placed on recruiting volunteers versus 
enforcing participation obligations. While certain individuals are 



^us, a more mandatory program involves more frequent tracking of clients' activities 
and status, more narrowly defined deferrals issui\l for shorter periods of time, fr»?quent 
communications ^o clients concerning the fact that program participation is mandatory, 
and adequate but notdrawn-out conciliation priKedures for incJividuals who fail to comply 
with program participation requirements. The extent of a program's mandate also depends 
on other program design choices: e.g., what individuals are required to do, whether they 
are given a choice, and the length of the requirement. 
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theoretically exempt and others are "required" to participate, the mes- 
sage of a program will be determined by the balance between serving 
people in the two groups and the extent to which the program actually 
enforces a participation mandate on people in the non-exempt group. 

Case Management and Monitoring Capacity, Participants do not 
automatically link up with needed support services and program activi- 
ties. In the single-component or short-ternv fixed-sequenced approaches 
of the early and mid-1980s, managing and monitoring the caseload to 
assure program participation was relatively straightforward. In more 
complex JOBS programs - particularly those that involve extensive 
cross-agency referral and coordination - case management and assess- 
ment practices and reliable management information systems are likely 
to be important factors in determining whether welfare recipients 
actually show up and receive program and support services. 

The Target Population for the Program. Past research has found 
that impacts vary substantially for different AFDC subgroups and are 
more consistent for women on AFDC than for men in AFDC-UP cases 
(e.g., Friedlander, 1988b; Grossman, Maynard, and Roberts, 1985). In 
an environment of limited funding, states may choose to target more 
intensive services - or even the entire welfare-to-work program - on 
certain groups of recipients rather than attempt to reach the full non- 
exempt caseload. 

The Range of Potential Program Impacts 

The impacts themselves are the final element in Figure 2.1 Welfare- 
to-work programs can have a wide range of direct and indirect effects on 
AFDC recipients and their families. These include impacts on work and 
income (earnings, employment rates, total income, and poverty rates), 
receipt of public transfers (AFEXI, Medicaid, Food Stamps, and other 
benefits), family formation, health status, educational attainment and 
achievement, family functioning and parenting, and the well-being ~ 
alonga numberofdimensions-of children in AFEKT families.^' Chapter 
3 discusses the range of impacts measured in different program eval- 
uations; Chapters 4 and 5 present what has been learned; and Chapter 6 
points to the major gaps in knowledge about certain types of impacts. 



'^St?e Wilson and i:ilw(K)d, 1989; Brooks-Gunn, 1989; Cherlin, 1989, for a review of the 
direct and indirect mechanisms through which JOBS programs can affec<: children in 
AFDC families. 
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Estimating Program Impacts 

The framework in Figure 2.1 points to several challenges in estimat- 
ing the impacts of welfare to-work programs. These issues underlie thfe 
discussion of studies and evidence in Chapters 3 to 5. 

The Distinction Between Outcomes and Impacts. Administrators 
operating welfare-to-work programs typically have information on the 
behavior of people who participate in a program: e.g., whether they take 
jobs or leave welfa re (the job placements or case closu res of people in the 
experimental group, as indicated by the "Experience of Experimentals" 
in Figure 2.1). The framework in this chapter indicates that these 
"outcomes" - sometimes called "gross impacts" - will always overstate 
programachievements. This is because they count all positivechanges as 
program accomplishments and do not identify the extent to which any 
changes in status actually result from the welfare-to-work program, 
rather than the underlying welfare dynamics, where people constantly 
enter and leave the rolls of their own accord (as indicated by the 
"Experience of Controls" in Figure 2.1). 

As illustrated in Figure 2.1, the correct measure of a program's 
success is its "net impact"- the change in an outcome (e.g., in the 
employment rate) that results only from the program. The challenge in 
estimating this is to distinguish accurately between program-induced 
changes and the normal dynamics of welfare turnover and labor market 
behavior represented on the left-hand ide of Figure 2.1. This requires a 
precise estimate of what would have happened to people in the program 
in the absence of the intervention. 

The Role of Random Assignment Field Experiments. A number of 
recent studies and advisory panels point to the difficulty of developing 
a control group that accurately mimics the behavior of program enroll- 
ees. They urge the value of classical experiments using random assign 
ment as a way to obtain accurate and unbiased estimates of the behavior 
of people with and without a program, and thus of the program's net 
impact. For example, a National Academy of Sciences panel concluded: 



Our review of the research . . . shows dramatically that control 
groups created by random assignment yield research findings 
about employment and training programs that are far less 
biased than lesults based on any other method. . . . Future 
advances in field research on the efficacy of employment and 
training programs will require a more conscious commitment 
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to research strategies using random assignment.^^ 

Of course, using a random assignment design does not assure valid 
inferences. As with non-experimental studies, the design must be 
implemented carefully and must be relevant to the key questions the 
study hopes to answer. Recognizing this, the same National Academy of 
Sciences panel recommended 

the following conditions as necessary but not sufficient for 
quality research: (1) the use of random assignment to participant 
and control groups and to program variations; (2) reasonable 
operational stability of the program prior to final assessment of 
effectiveness; (3) adequate sample coverage and low rates of 
sampleattrition; (4) outcome measures that adequately represent 
the program objectives, both immediate and longer term; and (5) 
a follow-up period that allows adequate time for program ef- 
fects to emerge or de ay.'^ 

While a social experiment can provide an unbiased estimate of the 
impact of adding a program to the existing array of services in the 
community, it is important to correctly interpret the resulting net impact. 
It does not show the total effect of the program, but only its effect over and 
above the services received by members of the control group. To the ex- 
tent that controls receive some services on their own - and many of the 
studies suggest that this service receipt can be substantial - it is a conser- 
vative estimate of the total effectiveness of the experimental treatment. 
Moreover, caution is called for in extrapolating the results to other con- 
ditions, e.g., to programs implemented at greatly expanded scale,**^ in 



^^Belsey.Hol! ter.and Papageorgiou, 1985, pp. 18;30.Seealsi) Job Trnining Longitudinal 
Survey Rese. ch Advisory Panel, 1985; Burtless and Orr, 1986; Ashenfelter, 1987; Lalonde 
and Maynard, 1 For a different view, see Heckman and Hotz, 1989. 

'^Betsey, Hollister, and Papageorgiou, 1985; p. 32. See also Burtless and Orr, 1986, for a 
detailed discussion of the methodological challenges facing both experimental and 
non-experimental studies. 

'"^While extrapolating findings from small-scale tests of programs intended for much 
larger-scale replication poses clear problems, this issue is minimized in some of the recent 
experiments that, as discussed in Chapter 3, for the first time evaluated full-scale, man- 
datory WIN and WIN Demonstration programs under real-world conditions. Because 
welfareto-work programs have never been entitlements (i.e., programs with adequate 
resources to serve all eligibles), it proved possible in these large-scale studies to imple- 
ment random assignment without reducing program scale. While, as a result, these stud- 
iesavoided manyof the concerns about extrapolation, potential threats to externa I validity 
exist, e.g., it is possible that the aeation of a control group caused the program to follow 
up on and serve a somewhat different group of people. See Gueron, 1985, for a discussion 
of the factors that contributed to the successful implementation of these large-scale social 
experiments that tested full WIN and WIN Demonstration programs. 
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different economic or administrative conditions, or with different 
recruitment practices. 

Net Versus Differential Impacts. Almost all prior random assign- 
ment field experiments have compared the outcomes for individuals in 
one experimental and one control group. The resulting net impacts 
reflect the changes brought about by the full program, including deci- 
sions on all seven of the dimensions noted above. In many v^ays, these 
programs represent a "black box," in that it is not possible, v^ith the 
precision of the experimental design, to determine either what factors in 
the welfare-to-work model are responsible for the program's success or 
the relative effectiveness of different services.'^ Such comparisons have 
to be made across sites and programs, with all the problems of compet- 
ing explanations and a small number of sites. 

An alternative approach is to use a more complex random assign- 
ment design to determine the relative effectiveness of different welfare 
-to-work programs. This requires that the random assignment design go 
beyond what is typical in most evaluations and involve the assignment 
of program eligibles to several different treatment options (as well as to 
a control group, if there is also an interest in measuring the net impact of 
each approach). This design is known as a "differential impact" study. If 
this could be successfully implemented, it would provide more com- 
pelling evidence on the relative payoff of different program approaches: 
e.g., programs that emphasize education compared to those that stress 
immediate job placement and labor force attachment. 

Estimating Impacts for Broad-Coverage and Selective-Voluntary 
Programs. In this synthesis, we distinguish between two types of stud- 
ies: those that evaluate welfare-to-work delivery systems (which we call 
"broad-coverage programs") and others that assess individual 
components (or potential components) within these systems (which we 
call "selective-voluntary demonstrations or programs" because of their 



For example, Heckman, 1990, argues that "t(i use the experimental metluni to evaluate a 
wide menu of pmposed pt)licies requires one randomization for each relevant policy 
variation. Since most propt)sc»d social programs have a large variety of potential options/ 
the experimental method entails one randomization for each option" (pp. 12-13), 

^^he success of differential impact designs depends on (1) disciplining random assign- 
ment and program operations to minimize crossovers (i.e., experimental or controls 
receiving inappropriate services), and (2) the actual implementation of the two or more 
experimental treatments. AsdiscussedinChapters3and4; these more complex experimental 
designs have been used - with mixed success - in studies of welfare-to-work programs in 
Virginia; Cook County, Illinois; and San Diego and Riverside, California. 
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recruitment practices). These two categories differ in their targeting, 
screening, selection, and participation rates, and these differences must 
be understood if evaluation results are to be accurately interpreted and 
compared. Chapter 3 defines these two types of programs and studies at 
length. This section focuses on the methodological implications of this 
distinction for interpreting program impacts.''^ 

VVelfare-to-work programs like WIN or JOBS are usually targeted at 
a broad group in the caseload: e.g., all AFDC applicants and recipients 
whose youngest child is at least 3 years old. If the program is mandatory, 
people in the eligible group can be affect'rd directly by actually participat- 
ing in program services or indirectly by the threat (or reality) of sanctions 
for not participating. (That is, nonparticipants can be deterred from con- 
tinuing to apply for or remaining on welfare by the prospect of required 
participation or the actual application of sanctions.) 

In evaluations of broad-coverage, mandatory programs where the 
structure and goals suggested that there might be indirect effects, 
researchers have estimated impacts across the full caseload that was 
actually subject to the participation mandate, including people who 
might never have gotten iheir grants approved or received program 
services.'** So that this could be done, random assignment occurred at 
either the welfare intake office or the office of the welfare-to-work 
program. The resulting experimental group included many people who 
went through intake, orientation, and specific service components, but 
there was typically a dropoff at each step - significantly reducing the 
participation rate in the actual service components - owing to a variety of 
factors such as normal welfare caseload dynamics, deterrence of non- 
participants, and temporary or permanent deferrals because of illness, 
child care problems, or part- or full-time employment. Evaluations of 
broad-coverage programs such as these show the impact of the entire 
welfare-to-work (WIN or JOBS) system on the caseload targeted for ser- 
vices. They answer the question: How is the average (targeted and/or 
enrolled) mandatory AFDC applicant or recipient affected by the exist- 
ence of the WIN or JOBS program? 



For a mo detailed discussion of these methtKlological issues, and of the uncontrolled 
variables ihM suggest caution in comparing a»sults across studies, see Friedlander and 
Gueroii, forthcoming. 

'^As discussed in Chapter 3, there were some differences across studies in who was 
included in the research samples. 
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This is a very different kind of question than that addressed in 
evaluations of particular voluntary employment and training compo- 
nents within welfare-to-workdelivery systems. (Since studiesof particular 
service components have only been conducted for voluntary activities, 
we call these "selective- voluntary demonstrations or programs/0 These 
programs are designed to affect only people who di'-ectly participate in 
services. As a result, to assess the impacts of such programs, random 
assignment is most appropriately located after program enrollment 
and ideally just at the point where participation in services is about 
to begin/*^ so that impacts are estimated for an experimental group with 
very high or even universal participation. Evaluations of these pro- 
grams show the impact of a specific employment-directed service on 
self- and program-selected volunteers. They answer the question: How 
is the average welfare applicant or recipient who gets into the program 
component affected by the services provided?^^ 

This methodological distinction is critical to the discussion of 
'^broad'Coverage" and "selective- voluntary" studies in Chapters 3 to 5. 
Because of it, impacts from these two types of studies are not dv/ectly 
comparable, even when both use experimental designs. One provides 
information on the effectiveness of a system that manages and offers 
services to a diverse caseload, some of whom participate; the other 
provides information on a particular component of the system for a 
subset of the caseload, most of whom participate. 

The distinction between broad-coverage and selective-voluntary 
studies is complicated by the fact that the completed studies are for 
programs that differed along three dimensions: 

• a focus on the full service delivery system or on a (potential) 
component within that system; 



Random assignment at this point is most appropriate to estimating the impact of the 
employment services; earlier random assignntent would provide information on the 
percentage of eligibles who actually participate in the component and would facilitate 
ger»*»rali2ability to the broader AFEXT caseload. 
20 

As an artifact of the timing of random assignment, however, some percentage of 
experimentalsin these studies may not actually receivei>ervices.Thus,in some evaluations 
of selective-voluntary programs (eg., the National Supported Work Demonstration), 
almost all experimentals actually received program services. In others, random assignment 
occurred earlier, and participation was less than universal, e.g., 89 percent of experimentals 
received program services in the J0B5TART Demonstration (Auspos et al., 1989), and 77 
percent in the Minority Female Single Parent (MFSP) Demonstration (Gordon and Burg- 
hard t, 1990). See Chapter 3 for a description of these projects. 
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• inclusion of the full eligible caseload (or a cross section of the full 
caseload) or of a subset of screened and selected eligibles; and 

• themandatoryorvoluntarynatureofparticipationintheprogram. 

The contrast between what we have called broad-coverage and 
selective- voluntary studies on the last two dimensions can be seen in the 
matrix below. Completed studies fall only in cells A (broad-coverage and 
mandatory) and D (selective and voluntary), although it is possible to 
operate and evaluate programs falling in cells B and C.^^ 



Dimensions of Program Design 





Mandatory 


Voluntary 


Wide range of eligibles, without screening 


A 


B 


Self- and program-selected eligibles 


C 


D 



Examples of programs that fit in different cells in this matrix are 
discuss'^d in the next chapter: San Diego SWIM and most other 
broad-coverage programs fall in cell A, Massachusetts ET Choices is in 
cell B, and the Homemaker-Home Health Aide Demonstrations and oth- 
er selective- voluntary programs are in cell D. While no current program 
fits into cell C, this combination is also possible. For example, in some 
states, the initially selective-voluntary New Chance program for young 
mothers (see Chapter 3), while remaining small-scale and selective, can 



^'Xhis distinction between program types sharpens our understanding of reality, but it 
does so by simplifying reality to some extent. First, while bnjad-coverage programs 
included a cross section of the eligible population (not just selected or motivated people), 
they did not always includeall people required to register with WIN, nor will present ones 
always include all of those who can be required to participate in JOBS. While some of the 
broad-coverage studies include all people found to meet the mandatory criteria during the 
period of the study, others are broad-coverage only for certain categories within the 
caseload (e.g., neiv applicants or young custodial mothers). Second, as discussed earlier in 
this chapter, the distinction between a mandatory and voluntary program is often a mat- 
ter of degree. It shou Id not be assumed that, because a program is mandatory, all those who 
participate do so under duress. In fact, people who take part in such programs represent 
a wide variety of levels of motivation, from those who wculd have volunteered for the 
program to those who are there only because of the threat of a redia?ton in their welfare 
grant (In addition, the enforcement activities of mandatory programs vary in intensity.) 
Conversely, while voluntary programs obviously enroll people who at some time elect to 
piirticipate, volunteers' motivation does not remain constant over the course wf their stay 
in the program. 




74 



FROM WELFARE TO WORK 



fulfill JOBS' mandatory participation requirement for out-of-school 
teen mothers. 

Figures 2.2 and 2.3 compare the scope of these two kinds of studies. 
Fi^re 2.2 shows the flow of clients in studies of broad-coverage pro- 
grams. The area enclosed by dashed lines represents the program activi- 
ties whose effects are measured by evaluations of these programs. Two 
illustrations of broad-coverage programs are given, depicting a 
fixed-sequence model (such as San Diego SWIM) that starts witn job 
search, and an up-front assessment model (such as Baltimore Options) 
that permits client and caseworker discretion regarding clients' activ- 
ities. Figure 2.3 shows the flow of clients in studies of selective-voluntary 
programs (such as the New Jersey OJT program, which was operated as 
a component within a larger, broad-coverage program - a likely sce- 
nario under JOBS). Note that in these studies the area enclosed by dashed 
lines contains only the activities of persons who were screened and 
chosen to enroll. (Persons who were screened out of the selective-volun- 
tary program, or who did not volunteer for it, may have been included in 
the activities of a broad-coverage program.) 

Because random assignment occurs early in the flow of people into 
services in studies of broad-coverage programs (as shown in Figure 2.2), 
the average measured impact - as well as the net cost per person - is 
spread across a larger number of individuals, only some of whom are 
affected by the programs' services or requirements. Thus, a finding of 
lower average impacts per experimental 'n broad-coverage programs 
would not necessarily mean that these programs provided less effective 
employment-directed services than selective-voluntary programs, hv- 
stead, it might simply reflect lower participation or the focus on a broader 
group of welfare recipients, including subgroups less likely to benefit 
from services. (See Maxfield, 1990, for an example of a recent summary 
that does not consider these issues in summarizing what past random 
assignment studies tell us about the relative effectiveness of different 
service approaches.) 

As a result, in assessing the results from prior studies, JOBS plan- 
ners and administrators should focus on findings for comparable pop- 
ulations, and be cautious in reaching conclusions about the relative 
effectiveness of alternative service approaches and sequences by 
comparing results across these two different categories of studies. 

The Need for Adequate Follow-Up. Different employment-directed 
services can be expected to produce their impacts over different periods 




FIGURE 2.2 BROAD-COVERAGE PROGRAMS: EVALUATION DESIGNS AND 
PROGRAM ACTIVITIES 
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NOTES: The bK)ttom part of the figure-enclosed within dashed lines- represents program activity 
captured in evaluations. 

In some studies, random assignment ixcumxl at the welfare office prior to program regis'.ra- 
lion, as shown here. In others, random assignment occurred at the welfare-to-work pro^.ram 
office. 
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FIGURE 2.3 SELECTIVE-VOLUNTARY PROGRAMS: EVALUATION DESIGN AND 
PROGRAV! ACTIVITIES 
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NOTES: The bottom part of the figure ~ enclosed within dashed lines - represents program activity 
captured in evaluations. 

In these studies, random assignment occurred at the selective-voluntary program office after 
screening, as shown here. 
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of time. For example, low-cost job search programs are intended to place 
people rapidly in jobs, with the hope that the initial placement will lead 
to a subsequent job and to some sustained impact on employment. 
Higher-cost education and training services anticipate making a larger 
up 5ront investment - at the expense, in the short term, of delaying entry 
into the labor force and serving fewer people - in anticipation that the 
new skills and "human capital" will ultimately allow the participants to 
obtain better and more stable employment. As a result, in the short run, 
it can be expected that a job search program will appear more successful 
than a human capital investment approach \ critical question is wheth- 
er, as is often assumed, the impacts of more intensive services are ulti- 
mately gieater and more long-lasting. Long-term follow-up (possibly 
five years or more) is essential to determining whether higher invest- 
ments deliver greater ever tual benefits, and the extent to which the im- 
pacts of different services increase or diminish over time. 

Estimating Entry and Macroeconomic Effects. To date, field 
experiments of broad -coverage systems have placed random assign- 
ment at the income maintenance or welfare to-work program office (see 
Figure 2.2). When well-executed, these studies provide a reliable esti- 
mate of the impact of a welfare-to-work program on the rate at which 
people who receive or apply lor AFDC benefits (the group randomly 
assigned) leave welfare as well as the impacts on their employment 
behavior. In other words, they capture the program's effect on welfare 
exits, i.e., on people delaying or speeding their departure from welfare 
as a result of the program's mandates and services. This is the first- 
order issue of whether a welfare-to-work program impacts those direct- 
ly involved in its activities and subject to its requirements. 

It is possible, however, that welfare-to-work programs affect case- 
loads by another route: by changing the rate at which people apply for 
welfare. For example, if JOBS administrators publicize the program's 
opportunity for education and training, this could attract people onto 
welfare; if they emphasize program obligations, this could deter people 
from applying. Since the JOBS message (and word-of-mouth publicity) 
is likely to vary across states and localities, the magnitude and direction 
- positive or negative - of any net effect on AFDC entries is unclear. Cap- 
turing these effects would require a different type of research design.^ 



t' Mdffitt, for ii discussiciii of the ptitenti.il of F^JA's onrichwi scrvias to encour- 
age welfare applications and of possible research designs for measuring this. 
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Further, the studies discussed in this volume - as with most evalua- 
tions of employment and training programs -did not attempt to measure 
the programs' general equilibrium or macroeconomic effects. Implicitly, 
these studies assumed that the increased employment of welfare recip- 
ients would not change the labor/inarket opportunities available to 
people not on welfare (e.g., that there would be little or no displacement 
or replacement oi other low-wage workers). Some of the studies used 
sensitivity tests to examine the importance of this assumption to the 
conclusions reached in the benefit-cost analysis.^^ 



This chapter has argued that studies of welfare-to-work programs 
are shaped by two things: the nature of the program (including its 
context) and the methodological choices made by the evaluators. They 
influence both the results of an evaluation and its policy relevance. 
Using the ideas presented in this chapter, the remainder of this syn- 
thesis discusses the completed and ongoing studies that are relevant to 
the JOBS program. 



^■^Seo, in particnlary Kumpufy Lon^y and Thorntony 1984; cind nlst) CJoldmany Hriedlandury 
and Lonj^, 1986. 
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The Studies of 

Welf are-to-Work Programs 



This chapter describes the data base for this synthesis: primarily fkld ex- 
periments used to evaluate welfare-to-work and other programs direct- 
ly relevant to JOBS. Despite the challenge of mounting such studies of 
complex social programs^ a substantial number have been completed, 
and more are under way. 

Practical consid^^rations limited the scope of this synthesis. Among 
the more notable and important bodies of research that were excluded 
are evaluations of school dropout-recovery programs, teen pregnancy 
prevention programs, and summer work programs for youth. These 
studies are not dir^cussed here because they usually do not focus specif- 
ically on AFDC recipients and because few have used experimental 
research designs. Their exclusion from this revii^w does not imply that 
they are not valuable sources of information for designers of state 
JOBS programs. 

ld*?ally, this chapter would present results separately for each ele- 
ment in the framework in Figure 2.1 in Chapter 2. However, most evalu- 
ations assess multi-dimensional programs, each of which combines into 
a single treatm^-nt its choice, for example, between ^emphasizing im- 
mediate job placement versus up-front education and training, its 
resources, itsdegree of mandatoriness, its support services, and its target 
populations. Evaluations reflect these "packages" of activities and 
attributes, and researchers have rarely structured studies to estimate 
with any rigor the impact of particular aspects of a program. 

Reflecting this reality, th<s review groups studies into two basic cat- 
egories that share imjxirtant design dimensions, rather than presenting 
evidence on each individual program feature. The studies are of 
"broad-coverage" programs, which includeall theelementsof a complete 
service delivery system, and "selective-voluntary" programs, each of 
which is the equivalent of a program component within a broader 
system. The categories, which were introduced in Chapter 2, can be 
described as follows: 
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• Studie i of service delivery systems. One group of program 
evaluations includes not only individual service components 
but also administrative activities (such as intake, orientation, 
assessment, case management, and monitoring) that affect the 
allocation of serx^ces, and which together make up a service 
delivery system. Because the systems studied are intended to 
reach a wide range of AFDC eligibles, with no screening, they are 
called broad'^coverage programs. Almost all of the completed 
studies in this category were of mandatory programs that, to 
varying degrees, required participation from people who were 
not likely to seek services on their own.' 

• Studies of program components. Another group of program 
evaluations does not encompass full systems but, in most cases, 
looks at small-scale demonstrations of a component (or poten- 
tial component) of a much larger broad-coverage program. All 
of the completed studies are of programs that encouraged but 
did not require participation by a subset of the AFDC popula- 
tion. These programs are "selective" in one or two ways: Eligible 
people can select whether or not to enroll, and program operators 
can select among eligible applicants. Because of these recruit- 
ment practices, these are called selective-voluntary programs 
or demonstrations. This category also includes the Job Train- 
ing Partnership Act (JTPA) system, which provides components 
of many JOBS programs.^ 

In addition, this chapter discusses three groups of studies that are 
relevant to particular policy issues raised by new provisions of JOBS: 

• Studies of education services in broad-coverage or selective- 
voluntary programs. 

• Studies of youth-oriented services in broad-coverage or 
selective-voluntary programs. 



Thiscategoryals<)inchidt^two studiL*sinprogrL*ssofbroad<ovtTagu voluntary progr^^ 
Massachusetts' Emp!oymentaiidTraining(HT) Choices prograinand Washington's Family 
Independence Program (HP). As discus^;ed below, the two L^juisville demonstrations had 
both voluntary and mandatory aspects. 

JTPA is itself a service delivery system. However, in the context of the JOBS program, 
JTPA usually provides particular training components or asst^ssinent function^ to selected 
participants. 
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• Studies of support services in broad-coverage or selective- 
voluntary programs. 

As a result; this chapter consohdates a number of the dimensions 
discussed in Chapter 2, on the basis of the available results. 

In understanding the relevance of these studies for JOBS, the most 
fundamental distinction is that between the broad-coverage and 
selective-voluntaryprograms.Broad-coverageprogramsare total service 
delivery systems that include linked decisions on program components, 
management strategies, support services, and caseload targeting. Usu- 
ally, they try to involve a large group or cross section of the eligible case- 
load. On a demonstration or ongoing basis, they in effect replace or are 
the WIN or JOBS system. Their evaluations thus assess the impact not 
only of the individual service components, but of the accompanying 
administrative activities and degree of mandatoriness. Selective-volun- 
tary programs, in contrast, usually target a more narrow population with 
a particular program approach; their evaluations assess the effec- 
tiveness of the particular employment-directed service. (See Figures 
2.2 and 2.3 and the discussion in Chapter 2 on "Estimating Impacts for 
Broad-Coverage and Selective-Voluntary Programs.") 

Broad-coverage programs can be mandatory or voluntary, although 
the studies completed to date are almost all of nominally mandatory 
programs. While individual program components could also be imple- 
mented as mandatory or voluntary options within a broad-coverage 
system, all of the experimental tests to datehavebeen of selective and vol- 
untary programs, prompting the nomenclature used in this synthesis. 

Table 3.1 summarizes the broad-coverage programs and studies. 
Some of them reflect WIN or JOBS programs implemented at full scale; 
others were smaller-scale demonstrations of WIN programs. With the 
exceptions noted in the table, all of these studies estimate the impact of 
a welfare-to-work delivery system on a cross section of the then-manda- 
tory single-parent (mostly female) AFDC caseload with school-age 
children. These studies thus cover a wide range of welfare applicants 
and recipients, including those not likely to seek services on their own. 

The other tables contain information on evaluations that illuminate 
particular aspects of the welfare-to-work system. These studies provide 
information about elements inside the "black box" of state JOBS pro- 
grams, but they were and are sometimes conducted under conditions 
that may not be directly relevant to the scale of the JOBS program. Table 
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3.2 lists evaluations of selective-voluntary welfare«to-work programs, 
which test particular employment services for groups of AFDC recip- 
ients who volunteer to participate and are screened by the programs (to 
meet specific eligibility or other requirements). These programs provide 
some of the components that are part of the broad -coverage system, but 
they are always voluntary and designed to target a caseload that is less 
broad than the full JOBS-mandatory population. 

Table 3.3 shows evaluations of educational programs. Table 3.4 lists 
evaluations of related programs for youth (often not limited to young 
people on AFDC). Table 3.5 shows tests of support services (e.g., testing 
the effectiveness of different child care services in increasing maternal 
employment). Within each table, the studies that have been completed 
are described first, followed by the studies that are still in progress. 

A great deal of program diversity is contained within each of the five 
clusters listed above. For example, the broad-coverage programs vary in 
their philosophy and message, their service model, their scale, and the 
intentions and goals of the state policymakers who designed them. This 
category includes programs that are mandatory and some that are 
voluntary; even the nominally mandatory programs vary in the extent of 
enforcement activities and aggressive outreach that they use to raise 
participation levels. The coherence of the category is empirical: All of the 
programs that are included involve a broad slice of the AFDC caseload, 
and thus represent an approximation of the operational issues that will 
confront the states' JOBS programs. Programs were assigned to all 
five clusters based on their observed target groups and program 
design features. 

The outcome measures used were a key attribute of the studies 
included in this synthesis. Because of funding limitations, the studies 
often estimated direct impacts for no more than three years after pro- 
gram enrollment on a series of outcomes that could be measured relative- 
ly cheaply using computerized administrative records: earnings, 
employment rates, AFDC receipt, and AFEXT grants. Important impacts 
that were either less frequently or never measured included impacts on 
wage rates, the nature of jobs held by welfare recipients, family forma- 
tion, total household income, poverty r^.tes, longer-term self-sufficiency, 
educational attainment and achievement, health status, and the well- 
being of children in AFDC families. Some of th^?se impacts will be mea- 
sured in several of the current studies, described below. 
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In addition to rraterial on outcome measures, the tables in this 
chapter contain the following information: 

• Thedate the impact evaluation began (which was not necessarily 
the same as the date the program began). 

• The evaluation's focus (the treatment received by the 
experimental group but not by the control group), identifying 
programs that assigned participants to a fixed sequence 
of activities. 

• The net cost per experimental (not the gross operating cost, but 
the difference between the total cost of the program per 
experimental and the program cost per control, with all 
sample members included in the calculations), in nominal (not 
constant) dollars.^ 

• Whether participation in the program was by design mandatory 
or voluntary (mandatory programs may also have allowed 
non-targeted persons to volunteer). 

• The target groups included in the evaluation. 

• The type of research design used, and whether a net impact or 
differential impact analysis was conducted. 

• The scale of the study, in terms of the operational and 
administrative units covered by the evaluation (the number of 
counties, welfare offices within counf ies, or demonstration ser- 
vice providersstudied)-e.g., the study may havebeen statewide, 
or it may have covered six counties or two welfare offices in one 
county or a fixed number of slots* 

• The length of the follow-up period from the time of enrollment 
in the program (these are generally the longest ^^^llow-up 
data reported and may not cover the full sample or all out- 
come measures). 

• A summary of the impact findings (for completed studies) or 
the date impact findings are expected. 



Ikvausi* sonic contrdls p.irticipatt\l in ihvs^.* si»rvicus, avLTagu nut cost is iiss than ihv 
avtTagL'Losti)fi)piTatin>;thcprogramperpLTSoninthLa»xperimLMitaigroup.StvA^^^^^ 
A for *^^urther explanation. 
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For each of the studies described in this chapter's tables/ references are 
provided in a list at the end of the chapter 

Broad-Coverage Programs 

Table 3.1 shows that there are 19 studies in progress or completed on 
welfare-to-work programs that are targeted broadly to include a wide 
range of AFDC recipients/ These programs are usually mandatory (e.g., 
Arkansas' WORK or New Jersey's Realizing Economic Achievement 
IREACHl), but they may be voluntary (e.g., Massachusetts' ET Choices); 
they may be relatively small-scale (Baltimore Options, also referred to in 
this synthesis simply as Baltimore) or statewide for all eligibles (Virginia 
and West Virginia).*^ They aredistinguished from the selective-voluntary 
demonstrations and programs listed in Table 3.2 in that, for the relevant 
scale and population, they are highly inclusive programs. That is, in- 
stead of servmg small numbers of self-selected, often highly motivated 
volunteers, they attempt to serve everyone who is targeted (or, in some 
cases, recruited) in a large population defined by specified eligibility 
criteria. Thus, usually through a particip ition requirement, but some- 
times through persistent recruitment, they seek to enroll and serve as 
many people in the targeted AFDC caseload as feasible or affordable. 

Two of the nine completed studies - the Louisville, Kentucky, 
experiments - were implemented prior to OBRA and are therefore not 
discussed at length in this chapter. (They are, however, included in Ta- 
ble3.1 because they representarareuseofanexperimental design during 
this earlier period.) These two studies assessed the effect of providing 
services designed to help individuals search for jobs. At the time, they 
were unusual in offering this assistance to new AFDC applicants - 
immediately, before they had been approved for welfare - as well as to 



Two earlier sludit^s .ire particularly ni)lcwt)rlhy, although their results are less direttly 
relevant because they reflected programs implemented prior to the passageof theOmnibus 
Budget Reconc iiation Act (OBRA) of 1981, which substantially changed the calculation 
of AFDC work incentives The large-scale evaluation of the WIN program used a 
quasi-experimental design to study the effects of WIN (and different WIN components) on 
a sample of 1974 and 1975 vviNenrollees (set* Ketron, 1980). The evaluation of the Employ- 
ment Opportunity Pilot Project (EOPP), a large->;cale, ten-site demonstration fielded be- 
twei»n 1979 and 1981, used a quasi-expi'rimental design to test a saUiration program 
providing a sequence of mtensivc job search assistance f()llow»-\l by subsidized employ- 
ment or training to those who did not obtain i regular job (see Brown et al., 1983). (HOPP 
was mandatory for AFDC recipients with children over 5 years old and voluntary for other 
single mothers.) 

^ These state programs may have bcvn modified since their evaluations. 
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TABLE 3.1 EVALUATION STUDIES RELATED TO JOBS: 
BROAD COVERAGE PROGRAMS 



Arkansas WORK 
Program 



Baltimore Options 



O.H)k County WIN 
Demonstration 



Start Date*^ 1983 

Major Sequence of group job 

Program search (followed by individ- 
ActivitiL»s ual job search) and (for a 

few) unpaid work 

experience 

NetCosl^ $118 



Mandatory M.^ndatory 
or Voluntary 

Target AFIX' applicants and 

Groups recipients with children 

3 or older 



Research Random assignnuMit, net 
Design impact 

Study Scale 2 of 75 counties 



1982 

Choice of individual or 
group job search, unpaid 
work experience, education, 
job skills training, 
on-tS:: job training 

$953 for AFDC 



Mandatory 



Applicants and riM:ipients: 
AI'DCs with children 6 or 
older; AFDC-UI's with 
children of any age 

Riindom assignment, net 
impact 



1985 

Ti»*:t of 2 programs: 

(1) individual job search; 

(2) sequence of IJS and 
unpaid work ex[>crience 



$127 for IJS; $157 for 
IJS/WE 

Mandatory 



ARX' applicants and 
recipients with children 
6 or older 



Random assignment, net 
and differential impacts 



11) of 18 income maintenance County wide 
centers 



Length of 
Follow-Up"-^ 

Outcomt^s 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



36 months 



Hmployment, earnings, 
welfare rt^ceipt and 
payments 

Increased e nployment and 
earnings: redacted welfare 
receipt and payments 



36 months 



Fmpioyment, earnings, 
welfare receipt and 
payments 

For AI-IX*: short-term 
increase in employment: 
increased earnings; no 
impact on welfare receipt 
and payments 



18 months 



Employment, earnings 
Welfare rtH.eipt and 
payments 

For IJS and IJS/WF: no 
impai t on employment 
and earnings; small 
reductions in v\ elfare 
fcwipt and pavments; no 
etfivt of WF component 
over and above the effect 
of IJS 



(cotitintied) 
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TABLE 3.1 Uontmued) 



lA)uisvillo WIN l^bomtory Kxpt»rimi»nts 



Individual Job Stvircli 



(Iroup JobSiMrch 



San Diego I 
(EPP/EWEP) 



Start Diite'^ 

M<]ji)r 

Prognim 

Activities 



197M 

Individual job search 



Net Cost 



b 



(19H5S) 



Mandatory Mandatory and 
or Voluntary voluntary 



Target 
Cj roups 



Rese,!rch 
Design 

St!idy Si. ale 

Lenglh of 
rollow-Up' 

Outtonu's 
Measured 



Impact 
Findings^ 
(or Da If 
Hx|x»cted) 



A FIX' applicants and 
recipients with cluldren 
ot any age 



Kandoni assignment, net 
impact 

I office 

33 months 



Fmployment, earnings, 
welfare receipt and 
payments 

Increased employment and 
earnings; reiluceil welfare 
receipt and payments 



19H() 

Group job search 



S230 
(19H5$) 



Mandatory and 
voluntary 

AFIX' applicants and 
recipients with children of 
any age 



Kandom assignment, net 
impact 

1 office 

12 months 



Fmployment, earnings, 
welf.ire receipt and 
payments 

lncreasi\l emplo/ment and 
earnings; nt> impact on 
welfare nveipt and 
payments 



1982 

Test of 2 programs: 

(1) group job search; 

(2) sequence of group job 
search and unpaid work 
experience 

For AFTC: $5ti2 forJS; 
$636forJS/Wt:, 
For AFIX^-UP: $S86for 
JS; $727 for JS/WH 

Mandatory 



AFIX' applicants with 
children h or older; 
AFrX'-UFapphcants 
with children of any age 

Random assignment, net 
ar, J differential impacts 

County wide 

18 months 



i:mployment, earnings, 
welfare nveipt and 
payments 

l or AFIX — |S only: 
inconsisU nt impaci on 
employment and earnings; 
short-term reduction in 
welfare payments. 
JS/ VVF: increasLvi 
employment and 
earnings; reduced welfare 
payments. 

lor AFIX:-1;F — )S only 
and JS/WH: no impact on 
employment and earnings; 
ri\iucL\' wi'Ifare receipt 
and payments 



(contmucd) 
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TABLE 3.1 (continued) 



San Dicgi) SWIM 



Virginiii ESP 



West Virginia CWEP 



Start Date"* 1985 

Major Sequence t)f group job 

Program search, unpaid work 
Activities experience, and education 

and job skills training; 

ongoing participation 

requirement 

Net Cost*' $919 for AFDC; $817 tor 
AFDC-UP 



1983 

Sequence of individual 
or group job search, unpaid 
work experience, and some 
education or job skills 
training (but only slightly 
more than controls 
received on their own)^* 

$430 



1983 

Open-ended unpaid 
work experience 



$260 for Al'DC 



Mandatory 
or Voluntary 



Mandatory 



Mandatory 



Mandatory 



Target Applicants and 

Groups recipients: AFIXs with 

children 6 or older; 

AFDC-UPs with children 

of any age 

Research Random assignment, net 
Design impact 



Study Sea le 2 of 7 welf a re offices 



AFIX' applicants and 
recipients with children 6 
or older 



Random assignment, net 
and differential impacts 



Applicants and 
recipients' AFDCs with 
children 6 or ol ler; 
AFDC^UPs with 
children of any age 

A FIX*: random assign- 
ment, net impact; 
AFIX -UP: matched- 
county comparison 
design, net impact 



1 1 of 124 welfare agencies^ AFfX: 9 of 27 

administrative areas; 
AFc>.-UP:8of 2/ 



Length of 
Folio w-Up*^ 



27 months 



33 months 



21 months 



Outconuvi 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



Fmployment, earnings, 
welfare receipt and 
payments 

For AFIX: increased 
employment and earnings; 
reduced welfare receipt 
and payments. 
For AFIX-UP: increased 
employment and short-term 
impact on earnings; 
short- term impact on 
welfare receipt and 
reduced welfare payments 



Fmployment, eartiwigs, 
welfare recoji»t and 
payments 



Increased employment and 
earnings; reduced welfare 
payments 



Fmployment, earnings, 
welfare receipt and 
payments 

!'or AFIX': no impact 
on employment and 
earnings; reduced 
welfare receipt and 
payments in final 
follow-up i|uarter 



Uvntinucd) 
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TABLE 3.1 (contiftued) 



Califomi«i GAIN 



Florid* ;ect 
Indepei.donce 



FiX)d Stamp Employment 
and Training Program 



Start Date^ 1988 



Major 

Program 

Activities 



NetCost^ 

Mandatory 
or Voluntary 

Target 
Groups 



Research 
LX?sign 

Study Scale 

I .ength of 
Follow-Up*" 

Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expectt»d) 



Education and job search 
followed by assessment 
and furthered^ ^alion, 
unpaid work experience, 
job skills training, or 
on-the-job training 



N/A 

Mandatory 



Applicants and 
rtHripients: aFIX:s with 
children 6 or older; 
AFDC'-UPswith children of 
any age 

Random assignment, net 
impact 



6 of 58 counties 
24 months 



Employment, earnings, job 
characteristics, welfare 
receipt and payments, 
household income, 
educational achievement 
and attainment, attitudes 

Interim, 19S inal, 
1993 



1990 

Job search for "job-ready" 
enrollees; assessment 
followed by education, 
training, or unpaid work 
experience for others and 
completers of job search 
without a job 

N/A 

Mandatory 



AFDC applicants and 
recipients with children 3 
or older 



Random assignment, net 
impact 



9 of 67 counties 
24 months 



Employment, earnings, job 
characteristics, welfare 
receipt and payments, 
family composition, 
educational attainment 



Interim, 1992; final, 1994 



1988 

Job search, job club, 
education, job skills 
training, unpaid work 
experience 



N/A 

Mandatory 

Food Stamp recipients 



Random assignment, net 
impact 

55 sites in 23 states 
12 months 



Employment, earnings, job 
characteristics, 
ht)usehol4* income, FtH>d 
Stamp ard welfare receipt 
and payments 



1990 
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TABLE 3.1 (continued) 





Illinois Early Access 
Program 


Massachusetts ET Choices 


New Jersey REACH 


Start Date^ 


1989 


1986 


1987 


Major 

Program 

Activities 


For most recipients, job 
search followed by 
assessp.ent, job club^ 
pre-employment training, 
education; job skills 
training; work 
experience; for a few 
recipients; education 
followed by other 
services 


Assessment followed by 
choice of job search, job 
club, education, job skills 
training, and /or supported 
work; transitional child 
care, health care 


Assessment; education, 
job skills training; job 
placement, support 
services 


NetCost^ 


N/A 


N/A 


N/A 


Mandatory 
or Voluntary 


Mandatory 


Voluntary 


Mandatory 


Target 
Groups 


AFDC recipients with 
children 3-5 


AFDC and AFDC-UP 
recipicMits with children 
of any age 


AFDC recipients with 
children 2 or older 


Research 
Design 


Random assignment, net 
impact 


Comparison group 


Matched comparison 
group 


Study Scale 


1 county 


Statewide^ 


Statewide^ 


Length of 
Folio w-Up^ 


18-60 months 


36 months 


24 months 


Outcomes 
Measured 


Employment, welfare 
receipt and payments. 
Medicaid receipt 


Employment; earnings, 
wage rates, job retention; 
welfare receipt; payments, 
and recidivism; post- 
program day care use 


Employment, earnings, 
welfare receipt and 
recidivism; household 
composition; child 
support collection 


Impact 
Findings^ 


N/A 


1990 


Interim, 1991; final, 
1994 



(or Date 
Expected) 
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TABLE 3.1 (continued) 



Ohio Transitions to 
Independence Evnlualion 



Pennsylvania Saturation 
Work Prof^rarA 



Riverside, California, 
Case Management Study 



Start Date*^ 1989 



Major Assessment, job club. 

Program unpaid work experience. 
Activities subsidized employment, 

education, job skills 

training 



NetCost^ N/A 

Mandatory Mandatory 
or Voluntary 



Target 
Groups 



Research 
Design 

Study Scale 

Length of 
Follow-Up^ 

Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



AFDC recipients with 
children 6 or older and 
AFIX-UP recipients 



Random assignment, net 
impact 



15 counties 



48 months 



Fmployment, earnings, 
job characteristics; 
welfare receipt, 
payments, duration, and 
recidivism; child support 
paym(.^nts family 
formation 

Interim, 1990, 1991, 1992; 
final, 1993 



1986 

Ongoing participation 
requirement, enhanced rase 
management, day care 



N/A 

Mandatory 



Applicants and recipients: 
AFDCs with children 6 or 
older; AFIK^-UPs with 
childrenof any age 



Random assignment, net 
impact 



h welfare districts in 
Philadelphia 

24 months 



Hmpliiyment, earnings, 
welfare receipt and 
payments 



1990 



1988 

Test of GAIN activities 
with case management 
provided with registrant- 
to-staff ratios of 
approximately (1)50:1 
or (2) 100:1 

N/A 

Mandatory 



Applicants and 
recipients: AFDCs with 
children 6 or older; 
AFDC-UPs with 
children of any age 

Random assignment, 
net and differential 
impacts 

Countywide 



24 months 



Fmployment, earnings, 
job characteristics, 
welfare receipt and 
payments, houst hold 
income, educational 
attainment, attitudt^s 



1992 
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TABLE 3.1 (contmued) 



Start Date^ 



Washington FIP 



Major Financial incentives for 

Program participation, education; 
Activities job skills training, 

increased subsidies for 
in-program child care, 
extended transitional 
benefits, cashing out 
FcHKi Stamps 



Net Cost"^ 



N7A 



Mandatory 
or Voluntary 



Voluntary 



Target AFIX: and AFIX'-UP 

Groups recipients with children 

of any age 

Research 2 matched groups of 5 
Desi^; \ counties each wore 

creattni; 1 gn jp was 
randomly selected to 
operate FIF, while the 
other group dtws not 
opi»rateFI F 

St Jdy Scale 10 countirs, 5 operating 
FIF and 5 in a comparison 
group 



Length of 
FolIow-Up*^ 

Outcomes 
Measurtxi 



36 montlis 



Hmployme^.t, earnings, 
welfare receipt, 
duration, and recidivism 



Impact 
Findings 
(or Date 
Expected) 



Interim, 1992; final, 
1993 



(i out if wed) 
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TABLE 3.1 (continued) 



NOTES: The programs are organized alphabetically within two categories: completed evaluations, 
beginning with the Arkansas WORK Program, and those still in progress, beginning with California 
GAIN. 

^The start date refers to the start of intake for the research sample. 

costs reported are per experimental unless otherwise noted. All net costs are in nominal 
dollars except for the costs of the Uiuisville WIN Laboratory Experiments, which are in 1985 dollars. 
Thesenct cost estimates indudeallexpendituresby the operatingagency specifically for the programs 
under study, as well as any expenditures by other organizations for services that were considered an 
essential part of the program treatment v in most of the programs included in this table, participation 
in these services was mandatory once an individual was assigned to them). However, the costs to 
operating agencies and to other organi^ations of serving members of the control groups have been 
subtracted in order to arrive at the net cost estimates. See Appendix A for further discussion. 

"^The follow-up period refers to the longest amount of follow-up available, although it may not 
apply to all groups or all measures in the study. 

*^For the most part, only ^;tatistically significant impacts are reported. In a few cases, how- 
ever, findings may reflect impacts that are consistent through the follow-up period, but not statisti- 
cally significant in the final months of follow-up. In multi-year studies, impacts are based on the final 
year of follow-up. 

*^The Virginia research design called for te^;ting two program models: one providing a SiHiuence 
of job search and unpaid work experience and the other adding education or job skills training. In 
practice, the two experimental groups received fairly similar program services and th'»re were not 
statistically significant differences tnjtween them in ./cifare and employment outcomes. Thus, the 
results are combined for the two experimental groups. (See Riccio et al., 1986J 

^The program operated statewide. 
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recipients. The first program provided three days of intensive instruction 
in job sea rch techniques followed by up to six v^eeks of counselor-d irect- 
ed, structured individual job search, where people followed up and re- 
ported back on job leads provided by WIN workers. The second program 
used group job clubs, where participants were offered one week of class- 
room instruction in job search skills, followed by up to five weeks of 
making at least 50 daily calls to prospective employers from a telephone 
room at the WIN office.^ Both programs provided incentive payments 
and reimbursement for job sea rch- related expenses and both were 
technically voluntary, but had voluntary and mandatory aspects.^ 

The other seven studies of WIN and WIN Demonstration programs 
of thel980s-Arkansas;Baltimore;CookCounty (Chicago), Illinois;" Vir- 
ginia;^ West Virginia; San Diego I;'" and San Diego's Saturation Work 
Initiative Model (SWIM) - are most relevant to JOBS. These programs 



The job club priKcss contains a number of elements, "rarticipants were told to treat job 
search as a full-time job and were encouraged to use friends and relatives to obtain leads. 
They were trained in interviewing and siKial skiPs and used standardized scripts on the 
telephone to uncover job openings and get interviews. The basic philosophy is that there 
are many jobs that bi?come vacant and subsequently filled without going through an 
elaborate job referral network. Frequent telephone calls will liKate these vacancies and 
provide participants with opportunities they would not have had had they relied on job 
developers or want ads. As part of the program, Ihey were also given regular staff 
supervision and assistance and were involved in n peer support network" (Goldman, 
1989, p. 393). 

For mothers with children under age 6 (i.e., those outside the traditiona I W I N-mandatory 
category), participation was voluntary. Mothers with no children under age 6 could chot)se 
either to remain in the regular WIN program or to be randomly assigned for the special 
demonstration program. After they made their choice, however, compliance wasnominally 
mandator)', although monetary sanctions were not imposed. For this reason, the two 
Louisville programs are described as "mandatory and voluntary" in Table 3.1. 

^ In theCtH)k County WIN Demonstra tion, two progra m models were testtni: one providing 
individual job search and the other a sequence of individual job search and unpaid work 
experience. Throughout this book, CtK)k County participation, impact, and cost findings 
are reported for the job search/ work experience sequence. 

^ In the Virginia evaluation, the research dt»sign called for testing two program models: one 
providing a sequence of ji > search and unpaid work experience and the other a sequence 
of job stMrch, unpaid work experience, and education or job skills training. In practice, the 
two experimental groups received fairly similar program ser\Mces, and there were no 
statistically significant differences between them in welfare and employment outcomes. 
Thus, the participation, impact, and cost findings reported in this volume, as in the 
evaluation report, combine the results for the two experimental groups. (See Riccio 
etal.,1986.) 

In the San Diego I evaluation, two program models were tested: the Fmployment 
Preparation Program (EPP) and the Employment Preparation Program/Experimental 
Work Experience Program (HPP/EWFP). Throughout this biH)k, San Diego I participation, 
impact, and cost findings are reported for the EPP/EWEP sequence of job search and un- 
paid work experience. 
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were operated in states with diverse AFDC benefit levels and admin- 
istrative structures and under different local conditions. In addition, the 
programs themselves were quite varied along a number of dimensions, 
reflecting differences in resources, objectives, scale, ind program design. 

Program Goals. The programs in Arkansas, Cook County, and 
Virginia and the first San Diego program sought to get people into jobs 
and off welfare. The goal was job placement. The second San Diego pro- 
gram (SWIM) shared this goal but also had an explicit process objective: 
maximizing participation and imposing an ongoing obligation. In con- 
trast, the Baltimore program sought to improve the long-term economic 
security of participants by improving their skills and placing them in 
better jobs with higher job retention, even at the cost of an initial longer 
stay on welfare. Finally, the West Virginia program stressed the value of 
work per se; this recognized the difficulty of any unsubsidized place- 
ments, given the extremely high unemployment rate in the state during 
the study period. 

Targeted Population. Five of the programs targeted the typical 
WlN-mandatory caseload (applicants and recipients with children age 6 
or over, plus AFDC-UPs, where applicable);'^ Arkansas extended this to 
women with children age 3 or older; the first San Diego program limited 
this to AFDC applicants. There were also some differences in the cover- 
age of the samples across the different studies, which should be consid- 
ered in comparing participation rates and impacts.'^ 

Scale. The programs di ffered widely in scale. West Virginia, Virginia, 
Arkansas, Cook County, and San Diego I (for applicants only) sought to 



Since some of the programs were .ilriMcly opt»niting before the stiirt of nindom tissign- 
ment, thestudy simples usually were composed of applicants and new mandatories (e.g., 
people whose youngest child turned 6 years of age during the study period). 

For example, the Arkansas, Baltimore, and Cook County samples included all 
WlN-mandatory applicants and those recipients who wen* newly determined to be 
WlN-mandatory following the start of randon assignment (generally because their young- 
est child had turned 6 years old). The San Diego I study contained all WlN-mandatory 
applicants except those* who, at the time of application, were employed part- or full-time, 
were refugees, or were monolingual in a language other than English or Spanish. The San 
Diego SWIM study consisted of all WlN-mandatory applicants, rt»cipients who were new- 
ly determined to bt» WlN-mandatory following the start of random assignment, and recip- 
ients who were currently mandatory and renewing their registration. The Virginia sample 
also consisted of all WlN-mandatory applicants and recipients (including those currently 
mandatory) except those who, at the time of random assignment, were active or already 
scheduled to be active in the HSP program, had previously bec*n in the HSP program, or were 
in full-time non-HSP education or training. The West Virginia sample contained all 
WlN-mandatory applicants and recipients (including those not newly mandatory) except 
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include everyone in the targeted population who resided in the areas 
where the program operated, with the exception of members of the 
control group.^^ As a result, in contrast to earlier studies, these were 
evaluations of full-scale WIN programs that were implemented under 
normal operating procedures. San Diego's SWIM program was also 
implemented at full scale in two of the largest offices in the county (while 
the other five offices continued to operate the San Diego I approach). 
Baltimore was the most constrained, with a program that could serve 
about 1,000 new enrollees per year, drawn at random from eligibles in 
about half of the city. 

In addition, San Diego SWIM for AFDCs and AFDC-UPs, and the 
AFDC-UP component of the West Virginia project, were specially fund- 
ed to test the feasibility of imposing an open-ended participation require- 
ment on as many people as possible. While the other sites also sought to 
reach everyone in the targeted population, they often did not have the 
funds or the active mandate to maximize participation rates. 

In all of these studies, because random assignment occurred at ei- 
ther the welfare or welfare employment program office, the programs' 
impacts were estimated across everyone in the targeted population - 
i.e., the full WIN-mandatory caseload, all applicants (in San Diego 1), or 
a cross section of 1,000 applicants and recipients (in Baltimore) - rather 
than for the smaller number who actually received services. 

Average Cost. The programs differed widely in average net cost (the 
operating agency's average cost per enrolled experimental minus its cost 



those who, al Iht* lime of mndtmi assi^nmonl, wltc eniployt'd pari- or full-liniu or in 
full-lime schtH)l or Iraining. 

The iwo Louisville expi rimenls invol veil femak^s newly re>;islerin^ wilh WIN dur- 
ing Ihe sludy periods (those wht» were new niandalorits and I hose who volunleertni), in- 
cluding b<)lh applicanls and rtvipienls. The Touisville linmediale (Individual) Job Sc«arch 
Assislante Hxpt rimenl sample conlained all people in ihis groupexcepl for Ihe 24 perceiU 
who, al Ihe lime of random assignment were employed or in schiH>l or Iraining and nol 
inlerisled in kH)king for a job or Ihe very small numbtT who refused lo parlicipale in Ihe 
sludy. The Touisville Ciroup job Search sludy had k*ss broad coverage, since il scrcvnini 
oul women who were unlikely lo parlicipale. Overall, aboul 56 percenl of all new female 
WIN regislranls were excluded from ihe sample bi*cause Ihey remst\i lo parlicipale in 
Ihe program and Ihe sludy, had personal or family medical problems, were in sch(H)l or 
Iraining full-lime, or were enipk)yt.Hi fulUlime. In olher studies, many of ihese pt^^ple 
would have bcvn included in ihe sample and possibly deferred from parlicipalion. (bee 
Wolfhagen, 1983, Aptx?ndix D.) 

Thai is, wilhin Ihe sludy counliis, and in Wesl Virginia and Virginia also Ihroughoul 
Ihe slale, all WlN-mandalories were required lo parlicipale, wilh ihe exception of mem- 
bers 0/ Ihe control group. 
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for the average control) from a low of less than $200 per targeted eligible 
person in Arkansas and Cook County - which used only their regular 
WIN funds and could provide only minimal services*^ - to a Itigh of more 
than $900 per eligible in SWIM and Baltimore. Gross costs (the cost of all 
services provided to members of the experimental group, including 
program operating costs, support services and allowance costs, and the 
costs of registrant-initiated education and training not provided directly 
by the program) were somewhat higher, ranging from $162 and $421 in 
Arkansas and Cook County, respectively, to $1,545 per targeted AFDC 
eligible in SWIM.'^ Many state JOBS budgets are likely to have resources 
per targeted case that fall within this range. 

The studies of the seven programs also differed in the requi ements 
imposed upon and services offered to members of the control groups. In 
Arkansas, Cook County, San Diego SWIM, and Virginia, controls were 
excused from WIN participation requirements and services except, 
depending on the program, registration, orientation, assessment, or 
allowances and support services. In San Diego I, Baltimore, and West 
Virginia, controls were treated as mandatory registrants in the "regular" 
WIN program that had been operating at the site before the introduction 
of the more enriched programs (Options in Baltimore and EPP/EWEP in 
San Diego) orCWEP (in West Virginia). Because of these differences, the 
study results should be interpreted somewhat differently. The first four 
studies show the net impact of the new WIN or WIN Demonstration 
program, compared to controls who were not offered any particular 
services. In contrast, the San Diego I, Baltimore, and West Virginia 
studies, in effect, estimated the incremental impact of the new program 
over and above the relatively inactive WIN program then operating in 
those sites. ^'^ 

Program Model: Duration. While all seven programs were 
mandatory - i.e., people could be sanctioned and lose some benefits if 



While Table 31 shews the Gxik County and Arkansas programs as having similar 
n()minalc()Sts,thcresi»arch team involved in bt)thstudiesa)nc!uded that lowerstaffs^ 
in Arkansas probably suggested that greater real program resources were available there. 

See Appendix A for further details. !n particular, becdust* of data limitations the Ar- 
kansas gross cost estimates may not capture all the indirect program expenditures. 

^^'In the twoother completed broad-coverage studies- the U)uisville Individual JobSearch 
study and the Louisville Group Job Search study ~ controls received regular 
WIN services. 



ERIC 



STUDIES Of WELFARE'TO'WORK PROGRAMS 



they refused to meet program requirements - five imposed obligations 
that usually lasted no more than four or five months. Only tv^o - West 
Virginia and San Diego SWIM - actually mandated participation for as 
long as someone remained on welfare. 

Program Model: Activities and Sequencing. West Virginia re- 
quired recipients, in exchange for their benefits, to do unpaid work as 
part of the state's Community Work Experience Program (CWEP). (The 
requirement to work in exchange for welfare benefits is commonly 
referred to as ''workrare.") The other programs imposed a participation 
rather than a work requirement. All of the programs except Baltimore 
used a fixed sequence starting with two to four weeks of job search, an 
activity in which a person is required to look for a job. This component 
of the programs reflected the general job search approach: 

Rather than training welfare recipients or developing specific 
jobs for them, such programs presump that with instruction, 
modest financic . assistance, and some structure within which to 
operate, many welfare recipients will be able to find jobs and be- 
gin to support themselves through their own efforts. Individual 
job search programs supply job leads; participants assume 
much of the burden of job hunting and report back to their coun- 
selors on their efforts. Group job search programs generally 
begin with classes on job search techniques and then place 
participants in group settings where they make ''cold calls" to 
prospective employers.*^ 

Some of the programs (e.g., San Diego 1 and San Diego SWIM) used the 
group job search /job club technique and provided considerable assis- 
tance; in other cases (e.g.. Cook County), aid was extremely minimal. If 
they did not find employment, program registrants might next be re- 
quired to work for up to three months in an unpaid work experience po- 
sition in a public or private nonprofit agency, where the monthly work 
hours usually equaled the grant divided by the minimum wage. (This 
requirement was strictly enforced in the two programs in San Diego, and 
much less so in Arkansas, Chicago, and Virginia. As a result, as shown in 
Table 4.1, only a minority of participants moved from job search into 



Goldman, im p. 390. 
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work experience.) After this, in Arkansas, Chicago, Virginia, and San 
Diego 1, the participation requirement ended.'* 

With the variations noted, the Arkansas, Chicago, San Diego I, 
Virginia, and West Virginia programs represented an Option 1 choice of 
low-cost services, using the categories presented in Chapter 2's section 
on "Funding for the Program/' The other two broad-coverage programs 
reflected an Option 3 mixed strategy, and thus came closer to meeting the 
vision in the JOBS legislation. While job search remained the largest sin- 
gle activity, these two programs included some more intensive services. 
These programs also reflected the main JOBS alternatives for deciding 
how toalkxateand target intensive services. In San Diego SWIM, services 
were provided in a fixed sequence, with assessment and referral to 
education and training required and reserved for those who did not find 
employment as a result of initial job search followed by work experience. 
In contrast; Baltimore used a process of assessment, case manager guid- 
ance, and c'lent choice to determine how people were assigned to a 
variety of employment-directed services provided by the CETA/JTPA 
program: job search, unpaid work experience, or a range of short- or 
longer-term education and training activities.*** 

In Baltimore, as a result, as distinct from the other six programs ex- 
cept SWIM, a substantial share (one-fifth) of enrollees received education 
and training, which included classes designed to introduce them to the 
world of work, tutoring, adult basic education, preparation for the GED 
(General Educational Development) test, and classroom-based job skills 
training (see Table 4.1 ). These activities varied in length, from one or two 
weeks in the worid-of-work sessions to 18 months in some training pro- 
grams, with average participation of about 19 weeks for the 14 percent of 



Si)mt.»oflhe:>t.' programs tailed for "rt»cytling" through thcamiponcnts for those whodid 
not find jobs. In Virginia, for oxamplc. rogistrnnts were to be reassessed after each 
component or at least every ^) days; however, persons who were employt\l part-time or 
were enrolk\i in long-term training activities were to be reasst»ssi»d every six mt)nths. In one 
version of Virginia's program (stv Table 3.1), people were supfKist^d to go into iniucation 
and training after unpaid work expt»rience. However, ihe study found that the program 
caust\i little increase in participation in Ihesi'activities. Thus, in practice, the Virginia model 
was also a )• ^ search/ work experience program. 

^^'The Baltimore program was m»mag(\i by the Office of Manpower Resources the local 
CI'TA prime sponsor (which subsequently became the JT l^A Service Delivery Area). 
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registrants who were in activities other than world-of-work or tutoring 
(Friedlander etal., 1985a).^ 

Ten studies of broad -coverage welfare-to-work programs are in 
progress. These should prove particularly relevant to JOBS adminis- 
trators, since they include programs that are multi-component, serve 
women with younger children, or operate under JOBS regulations. Most 
studies test mandatory programs, but two of them examine broad- 
coverage voluntary initiatives. 

For example, California's GAIN program requires people to 
participate in a range of services, starting with education for those who 
score poorly on a test, lack a high school diploma or GED, or are not 

proficientin English. Others receivejobsearchtrainingand other services. 
Florida's Project Independence provides up-front job search for more 
job-ready enrollees, and assessment followed by a range of services for 

others. The Pennsylvania Saturation Work Program(PSWP)shares some 
of the features of San Diego's SWIM program, since it vas also funded 
as a special demonstration to test the maximum feasible participation in 
program services. The evaluations of Massachusetts' ET, Ohio's Tran- 
sitions to Independence, and New Jersey's REACH programs focus on 
multi-component Initiatives that allocate services based on a more 
comprehensive assessment. Washington's FIP program goes beyond the 
usual welfare-to-work services and restructures work incentives and 
transitional services. The California, Pennsylvania, and Ohio evalua- 
tions include only AFDC applicants and recipients with school-age 
children (and AFDC-UPs), but the Florida, Massachusetts, New Jersey, 
and Washington studies also include welfare recipients with younger 
children. 

Three other broad-coverage studies are listed. The Riverside Case 
Management study tests the impact and cost-effectiveness of GAIN ser- 
vices offered through regular or enriched case management. (Enriched 
case management is defined in this study as an increased staff-to-client 
ratio.) The goal of this differential impact study is to determine both the 
prt)gram's overall impact, and whether enhanced case management 



20 



The subsLintial n^ituri- of thi- tiluotiim pro^jnim in Baltimore- is rcflutt-d in the hiKh 
^",^'''3'^' '''-^'K'H'd to i^lucition i.r j«.b skills training (Friul- 
laniluret al., 19K.-,a). l urthcr, tho Baltimore program - as with SWIM and West Virginia - 
was di-sigm-d to ri^iuirf continuous participation as long as somt-one ri'mainod on wtOfaro; 
how .'ViT, this was not, in t.u t, impleme ntt-d. 



ERIC 



FROM VVKLFARE TO WORK 



improves program results. The Food Stamp Employment and Training 
Program requires participation in a range of services by Food Stamp 
recipients v^ho are not required to participate in WIN or JOBS programs. 
The Illinois Early Access program focuses on AFLXZ recipients with 
children age 3 to 5 in one county, and evaluates mandatory welfare-to- 
work services for this now JOBS population. 

Selective- Voluntary Programs 

This category includes selective-voluntary programs that do not 
seek to serve as broad a group in the AFDC caseload, including large-scale 
pn.grams such as the JTPA system and smaller demonstration pro- 
grams such as the Minority Female Single Parent (MFSP) program and 
the National Supported Work Demonstration. By nature, these programs 
serve a group of people who are motivated to seek out services and, 
sometimes, screened to 5?et program eligibility and other standards. 
Such programs are usually substantially more expensive^^ and tend to 
be operated on a smaller scale than broad-coverage progra ms. They have 
thus been able to offer more complex, comprehensive services. 

Selective-voluntary programs are components within welfare-to- 
work systems, and the studies provide valuable information on the pay- 
off of providing particular services to groups within the welfare caseload 
who are interested in and seek to receive the services. They also provide 
lessons relevant to JOBS' new emphasis on targeting and intensive 
services, hi some cases, these studies are directly relevant to the likely 
scale of these components in state JOBS programs; in others, they were 
special, multi-site, small-scale demonstrations of programs that could 
be expanded as specifically targeted components of broader JOBS initia- 
tives.^ In addition, the findings are relevant to JOBS programs that re- 
cruit welfare recipients to participate in various voluntary components; 
this "brokering" approach to JOBS may resemble the recriutment pro- 
cesses used in the evaluations of voluntary welf? re-to-work programs. 



The average unit cost t)f Si»lt.»ctive-voluntary prt>grt»nis may excet»d the average unit cost 
of broad -coverage programs for two reasons: First, the sc»lectiv<^voluntary programs may 
provide more expensive services; second, since they sen'e only volunteers, they may have 
very high rates of stTvice utiU/ation. Thus, if the servict.»s in tht.»se programs were provided 
in JOBS, the cost per targettni person would be lower than in the demonstrations. 

^ If tht»se test program^; are substantially expanded or retargeted under JOBS, it would bv 
important to determine whether the results from the small-scale demonstrations could 
be replicated. 
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EVALUATION STUDIES RELATED TO JOBS: 
SELECTIVE-VOLUNTARY PROGRAMS 



Start Dale^ 

Major 

Program 

Activities 



NetCost^ 



Mandatory 
or Voluntary 

Target 
Groups 



Research 
Design 

Study Scale 

Length of 
Follow-Up^ 



Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



AFDC Homemaker- 
Home Health Aide 
Demonstrations 

1983 



Maine OJT 



1983 



Home health aide training Sequence of -mployability 
and subsidized employ- training, unpaid work 
'"^"^ experience, and subsidized 

on-the-job training 



$9,505 

($5,957-$12,457 
across states) 
l$5,684J^ 

Voluntary 



AFDC recipients for at 
least 90 days and not 
employed as home health 
aide during that time, 
with children of any <ige 



Random assignment, net 
impact 

70 sites in 7 states 

33 months after the end 
of program participation 



$2,019 
l$l,635]'' 



Voluntar)' 



Random assignment, net 
impact 

Statewide 



33 months 



Employment, earnings, job Employment, earnings, 
charact.^ristics, welfa.c* welfare receipt and 
receipt and payments payments 



National Supported 
Work Demonstration 

1976 

Structured, paid work 
experience 



7,981 
i$9,447j^'^ 
(1985$) 



Voluntary 



Unemployed AFDC recipients 
on welfare for at least 
prior 6 months, with 
children of any age 



Increased employment in 
4 states; increased 
earnings in 5; increased 
wage rates in 4; 
increased hours of work 
in 4; reduced AFDC and 
Food Stan>p payn>ents in 4; 
no effect on Medicaid 



Increased employment and 
earnings; no reductions in 
welfare receipt and 
payments 



AFDC recipients on 
welfare for 30 of prior 
36 months with children 

6 or older, unemployed 
with limited recent 
work experience 

Random assignment, 
net impact 

7 sites 

27 months (plus 
supplemental follow-up 
averaging 33 months) 

Employment, earnings, 
hours worked, wage 
rates, welfare receipt 
and payments, total 
income, child care use 

Increased earnings, 
hours worked, wage 
rates; decreased welfare 
receipt and payments; 
no impact on total 
income; increased use 
of child care^ 
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TABLE 3.2 (continued) 



New Jersey 
0)1 



Start Date^ 1984 



Minority Female National 
Single Parent Demonstration JTPA Study 



1984 



1987 



Major 

Program 

Activities 



Subsidized on-the-job 
training 



NetCost^ $787 
[$439]^ 



Fducation, job skills 
training, employability 
training, counseling, child 
care, other support 
services 

$2,679.H824 (gross cost) 
across sites 



JTPA services, 
including job search, 
job skills training, 
on-the-job training 



N/A 



Mandator)' Voluntary 
or Voluntary 



Voluntary 



Voluntary 



Target AFIX' recipients over 18 

Groups with children of any age 



Research Random assi'Miment, net 
Detiign impact 

Study Scale 9 of 21 counties 



I.ength of 24 months 
Follow-Up*^ 



Minority single mothers 
with children of any age; 
72% on AFDC or other public and (mt-of-schuol 



Economically 
disadvantaged adults 



assistance at baseline 

Random assignment, net 
impact 



It 



4 sites 



61) months 



youths 

Random assignment, 
net impact 

16 service delivery 
areas 

30 months 



Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



Fmploymenl, earnings, 
welfare receipt and 
payments 



No effect on employment; 
increast»d earnings; 
reduced welfare payments 



Employment, earnings, job 
charactenst'i's, welfare 
receipt and payments, 
family formation, home 
environment, educational 
attainment, child care use 

At 12 months: increased 
empk)yment, earnings, hours 
worked, wage rates at 1 
site; increa*Jed welfare 
receipt and payments at 1; 
increased GED attainment 
at all sites. Interim, 1991), 
1991; final, 1993 



Employment, earnings, 
household income, 
welfare receipt, family 
composition, educa- 
tional attainment, 
criminal behavior 

Interim, 1991; final, 
1992 



(amtimwd) 
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TABLE 3.2 (continued) 

New York State 
Comprehensive Employment 
Opportunity Support 
Centers (CEOSC) 



Start Date'' 1988 

Major Assessment followed by 

Program pre-employment training. 
Activities job skills training, 

education, job search 
assistance, support 
services including on- 
site child care 



Net Cost" 

Mandatory 
or Voluntary 

Target 
Groups 

Research 
Design 



Study Scale 

Length of 
Fol low-Up^' 

Outcomes 
Measured 



Impact 
Findings^ 
(or n»ile 
Expected) 



N/A 

Voluntary 



AFIXJ rec^ients with 
children under 6 

Random wissignment, net 
impact at 1 site; 
comparison group design 
at 2 sites 

3 sites 

24 months 



Employment, earnings, 
welfare receipt and 
payments 

W\ (comparison group); 
1992 (random assignment) 
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TABLE 3.2 (continued) 

NOTES: The programs are organized alphabetically within two categories: completed evaluations 
beginning with the AFDC Homemaker-Home Health Aide Demonstrations, and those still ii 
progress, beginning with the Minority Female Single Parent Demonstration. 
^The start date refers to the start of intake for the research sample. 

h'he costs reported are per experimental unless otherwise noted. All net costs are in nomina 
dollars except for the costs of the NationalSupported Work Demonstra tion, which are in 1985 dollars 
These net cost estimates include all expenditures by the operating agency specifically for thi 
programs under study, as well as any expenditures by other organizations for services that wen 
considered an essential part of the program treatment. However, the costs to operating agencies anc 
to other organizations of serving members of the control groups have been subtracted in order t( 
arrive at the net cost estimates. See Appendix A for further discussion. 

The bracketed figure excludes wage subsidy payments for participants, whereas the other figun 
includes them. 

Supported Work projects generated revenues of H352 per experimental (in 1985 dollars), whicl 
offset part of the cost reported here. 

*-The follow-up period refers to the longest amount of follow-up available, although it may no 
apply to all groups or all measures in the study. 

For the most part, only statistically significant impacts are reported. In a few cases, however 
findings may reflect impacts that are consistent through the follow-up period, but not statisticall> 
significant in the final monthsof follow-up. In multi-year studies, impactsare based on the final yeai 
of follow-up. In programs that tested the effects of subsidized employment, the impacts are for the 
post-demonstration period. 

^Because the Supported Work impact sample is not consistent for all years of follow-up, the 
findings reflect estimates trom different samples and follow-up periods. 

Each of the four Minority Female Single Parent (MFSP) Demonstration sites is a community- 
based organization. One of the four, the Cen^r for Employment Training (CET), operated MFSP in 
several northern California liKations, but is referred to here as a single site. CET is the MFSP opt>rator 
that was found to produce statistically significant 12-month impactson employment, earnings, hours 
worked, and wage rates. 
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The section on ''Estimating Impacts for Broad-Coverage and 
Selective-Voluntary Programs" in Chapter 2 discussed some of the 
methodological reasons for caution in comparing results across 
selective-voluntary and broad-coverage studies. These relate to the dif- 
ferent research designs (even when both use random assignment) that 
follow from the fact that one group of studies is of voluntary pro- 
grams, while the other is of programs that are usually mandatory. In 
particular, participants in selective-voluntary programs may differ 
from the caseload in broad-coverage studies in a variety of ways that 
affect measured program impacts. For example, they may be more 
motivated, more likely to use program services, and less burdened by 
barriers to participation such as child care or family problems.^ How- 
ever, some selective-voluntary programs have explicitly targeted 
highly disadvantaged populations. For example, AFDC participants 
in Supported Work averaged 8.5 years on welfare at enrollment, 
suggesting that voluntary programs can succeed in reaching very hard- 
to-serve groups. 

This group of studies provides important information to JOBS 
administrators, which can complement the lessons from the broad- 
coverage studies. Some of these evaluations, for example, provide find- 
ings for subgroups of AFDC recipients who were not assigned to 
broad -coverage, mandatory participation programs under the WIN 
regulations (women on AFDC whose youngest child was between 1 and 
6 years old) or who may not benefit from lower-cosl services (e.g., peo- 
ple who have received welfare for many years). Others offer reliable es- 
timates of the impact of more expensive services that will always be 
provided on a relatively limited scale. Finally, these studies also provide 
useful information on program operations, costs, and outcomes. 

Two of the evaluations of selective-voluntary programs provide 
information on the impact of subsidized on-the-job training (OJT) 
programs for welfare recipients and were implemented as full-scale 
components of state WIN Demonstration programs: the studies in Maine 
and New Jersey .^^ In New Jersey, job developers identified and screened 



These factors also mean, however, that members of the control group in selective-volun- 
tary programs may be more likely to receive alternative services in the community, which 
would make the estimates of program impacts more conservative. 

While a number of other studies of OJT programs funded through the diversion of 
AFDC grants were conducted during the 198US; they did not include rigorous evaluations 
or large study samples. 
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active WIN registrants and sought to place them in OJT positions with 
local employers, primarily in the private sector inrollees were hired on 
a trial basis for up to six months, with the understanding that individu- 
als who performed satisfactorily would be retained as regular full-time 
employees. The state reimbursed emn^overs for half the wages paid to 
OJT employees during the trial perioc In Maine, carefully screened 
enrollees were offered a prescribed sequence of activities that included: 
first, two to five weeks of pre-vocational training that stressed personal 
growth as well as job-seeking and job-holding skills; second, for those 
not judged ready for OJT, up to 12 weeks of 20-hour-per-week unpaid 
work experience in the public or nonprofit sector; and, finally, placement 
in jobs, primarily in the private sector, where employers were subsidized 
for 50 percent of the wages for up to six months. The three-phase pro- 
gram sought to help single mothers obtain jobs that paid more than the 
minimum wage and offered opportunities for advancement." 

The National Supported Work Demonstration provided very dis- 
advantaged A¥DC recipients with subsidized employment and related 
monitoring and support designed to improve basic work habits and 
skills. Supported Work offered highly structured, full-time work 
experience positions (paying approximately the minimum wage) for up 
to a year or 18 months (depending on the site) under conditions of grad- 
ually increasing demands, close supervision, and peer group support. 
Supported Work was operated by nonprofit corporations, which estab- 
lished small factories or work crews structured to provide worksites for 
crews of AFDC recipients, ex-addicts, ex-offenders, and young high 
school dropouts. Supported Work crews produced goods and services 
the sales of which generated revenues that partly offset project costs. 
Examples included the manufacture and sale of office furniture, house 
painting, operation of a gas station, and janitorial services. Supported 
Work wages, as was the case with earnings from OJT positions in Maine 
and New Jersey, were treated similarly to any unsubsidized income in 
terms of their effect on reducing AFDC and Medicaid benefits received 
by the participants. 



Because the New Jersey and Maine programs were components within the states' WIN 
systems and because of the nature of program recruitment, controls received substantial 
WIN services, costing between $410 and $660 per control. These control costs included the 
regular WIN administrative expenses for processing mandatory cases, which are not 
included in the costs of the specific selective-voluntary programs that are components 
within those systems. (See Appendix A.) 
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The AFEX: Homemaker-Home Health Aide Demonstrations tested 
the feasibility of training AFEXT recipients to assist functionally im- 
paired people in their own homes. Implemented in seven states, the 
model called for trainees to receive four to eight weeks of formal training 
followed by up to a year of subsidized employment, generally with 
established public and private nonprofit home care agencies such as 
those certified under Medicare. During the period of subsidized 
employment, trainees remained covered by Medicaid and received 
work-related support services; their wages were comparable to those 
paid to other such workers. The Health Care Financing Administration 
of HHS was the lead agency charged with implementing the 
demonstrations. 

The National JTPA Study will evaluate the varied approaches to job 
preparation that are offered by JTPA contractors. Two other 
selective-voluntary demonstrations, the Minority Female Single Parent 
(MFSP) Demonstration and New York's Comprehensive Employment 
Opportunity Support Centers (CEOSC) program, test approaches that 
provide comprehensive services, including education, job skills train- 
ing, employability training, and support services. Among the partici- 
pants in the MFSP Demonstration are some women with children under 
age 6, while the CEOSC program exclusively targets AFDC recipients 
with preschool children. Because women with preschool children are 
not included in most of the evaluations of broad-coverage, mandatory 
welfare-to-work programs, these studies are of particular interest. State 
JOBS programs will cover welfare recipients whose youngest child is age 
3 (or, at state option, age 1) and may provide education and training 
services similar to those provided in MFSP and CEOSC. 

Education Services 

Several welfare-to-work programs have included significant edu- 
cation activities in the package of services they provide to participants. 
GAIN emphasizes up-front education for those wlio lack a high school 
diploma or GED, are not proficient in English, or fail a basic skills test. 
SWIM provided education for some participants after they completed a 
work experience component. Virginia's Employment Services Program 
(ESP) referred some participants to education providers. The MFSP 
Demonstration provided a mixtureofeducationand job skills trainin;^ to 
participants. Florida's Project Independence assigns to education some 
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TABLE 3.3 EVALUATION STUDIES RELATED TO JOBS: 
EDUCATION SERVICES 



Job Corps Computer- 
Assisted Instruction Evaluation 



SIME/DIME Manpower 
Experiment 



Start Date* 

Major 

Program 

Activities 



Net Cost 

Miindiitory 
or Voluntary 

Target 
Groups 



Research 
Dt^sigii 

Study Scale 

Length of 
Follow-Up'^ 

Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



1987 

Substitution of some computer- 
assisted instruction fo< regular 
classroom instruction 



N/A 

Voluntary 



Job Corps members; 3\% female, 7% 
parents, 31% from families on public 
assistance 



Random assignment, net impact 



10 Job Corps Centers 

4 months (average) from pre-test to 
post-test 

GED test scores, TABE subtest 
scort»s, GED attainment, attendance, 
length of stay in Job Corps 

No impacts, except for a small 
increase in GED class attendance 



1970 

Test of 50% and 100% subsidies of 
education, job skills training, and 
related child care; vocational 
counseling 

N/A 

Voluntary 



Low-income persons 16-58 in families 
with at least 1 child, who were 
capable of employment, and who were 
in the Negative Income Tax Experiment 

Random assignment, net and 
differential impacts 

Research samples in Seattle and Denver 
6 years 



Employment, earnings, participation in 
education and training 



No consistent impacts on employment 
or earnings; for single female heads of 
families, impact on community college 
attendance of up to 1 college quarter 



NOTES: *^The start date refers to the start of intake for the research sample. 

^he follow-up period refers to the longest amount of follow-up available, although it may not 
apply to all groups or all measures in the study. 

^Only statistically significant imp »cts are reported. 
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participants who, it is determined, are not job-ready. These programs 
demonstrate the feasibiUty of including education in a welfare-to-work 
program, and provide information on participation in education activi- 
ties. The evaluations of these programs use net impact designs, which 
compare the employment, earnings, and welfare receipt outcomes for 
those targeted for the treatment services - including services other than 
education - to the outcomes for those in the control groups. This net im- 
pact design does not provide a specific test of the effectiveness of educa- 
tion services because the effects of education are not separated from the 
effects of other services. Therefore, thesr studies and their findings are 
discussed elsewhere (see the sections on "Broad-Coverage Programs" 
and "Selective-Voluntary Programs" in this chapter). Leamfare programs 
and programs using education and other services to serve young welfare 
recipients are discussed in the next section, 'Touth-Oriented Services." 

The GAIN evaluation will include a study of the program's literacy 
impacts. It will focus on experimental and controls who met GAIN 
criteria for being "in need of ed uca tion" at the time of ra ndom assignment 
(see above). A literacy test will be administered to a sample of these 
persons two years after they were randomly assigned. This study will 
measure the effect of GAIN on educational achievement. In addition, the 
impact of GAIN on registrants' attainment of edivational credentials 
(the GED or a high school diploma) will be measu red for this sample. This 
resf^arch will begin the process of understanding how the educational im- 
pacts of broad-coverage programs are related to their economic impacts. 
However, the complexity of this issue calls for considerable additional 
research, including differential impact studies that directly compare the 
economic effects of programs that emphasize education to those that 
do not. 

Two studies have used a differential impact design specifically to 
measure the effectiveness of education services. They are described in Ta- 
ble 3.3. In the Job Corps Computer-Assisted Instruction Evaluation, job 
Corps members were randomly assigned to receive instruction in basic 
academic skills and GED preparation either in traditional classroom set- 
tings or in settings that used a significant amount of computer-assisted 
instruction. In the Seattle-Denver Income Maintenance Experiment's 
(SIME/DIME) Manpower Experiment, the volunteer participants were 
randomly assigned to groups that were offered a 100 percent subsidy of 
their education and training expenditures, a 50 percent subsidy of those 
expenditures, or no subsidy. These evaluations provide the only 
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experimental studies of related programs that are specifically focused on 
education services. However, the synthesis of research presented in 
Chapter 5 also draws on the evaluations of broad-coverage and selec- 
tive-voluntary adult- and youth-oriented programs whose findings are 
relevant to understanding the role of education in wel fare-to- work 
programs. 

Youth-Oriented Services 

Programs that serve yoi'^g people who are welfare recipients are 
not, properly speaking, welfare-to-work programs. Their goals include 
preventing dropping out of school, returning teens to school, and 
providing additional education and/or training todropouts. Education 
plays a larger role in these programs than in the broad-coverage wel- 
fare-to-work programs discussed earlier, and job search has less prom- 
inence. Some of these programs also provide instruction in parenting 
skills because many young welfare recipients are the mothers of in- 
fants. Given these diverse goals, the outcomes measured in evalua- 
tions of youth-oriented programs often include educational attainment 
(IS well as employment and earnings. 

The studies summarized in Table 3.4 include evaluations of broad- 
coverage, mandatory programs that include aspects of "luarnfare" 
(Ohio's Learning, Earning, and Parenting [LEAP] Program and the 
Teenage Parent Demonstration) for young AFDC mothers, and selec- 
tive-voluntary, comprehensive service models for males and females 
(job Corps and JOBSTART) as well as teen mothers (Project Redirection 
and New Chance). With their focus on mandatory education and other 
servicesforteenageparentson AFDC.theongoingOhioLEAPand Teen- 
age Parent Demonstration evaluations are directly relevant to JOBS, 
since school attendance is likely to be the sole JOBS activity for most 
custodial parents under age 20 who have not completed high school, '^he 
Teenage Parent Demonstration will also provide information on the 
effects of job skills training and job search for older teens. Its education 
activities includea life skills instruction component. Project Redirection, 
which has been completed, provides evidence about the effects of a 
voluntary program model that coordinated an array of services - 
education, parenting instruction, and employability training - to teen 
mothers age 1 7 or younger. The ongoing New Chance Demonstration is 
targeted to older teens and is more comprehensive in scope, including 
more emphasis on counseling, case management, and occupational 
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TABLE 3.4 EVALUATION STUDIES RELATED TO JOBS: 
YOUTH-ORIENTED SERVICES 



Job Corps 



Project Redirection 



JOBSTART 



Start Date^ 

Major 

Program 

Activities 



Net Cost^ 

Mandatory 
or N'oluntary 

Target 
Groups 



Research 
Design 

Study Scale 

Length of 
Follow-Up^ 

Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



1977 

Education, job skills 
training, job placement, 
support services, health 
care, in a residential 
setting 

C5,735 per enrollee 
Voluntary 



Economically disad- 
vantaged youths Uv21; 
42% of females v^ere in 
families receiving cash 
welfare prior to 
enrollment 

Comparison group, net 
impact 

One- third of residential 
Job Corps enrollees 

54 months 



Employment, earnings, 
welfare receipt, 
enrollment in further 
education or training, 
nulitary service, criminal 
behavior, health 

Increased employment and 
earnings; reduced welfare 
receipt; increasini 
educational attainment; a 
shift from more to less 
serious crimes; improved 
health 



1980 



1985 



Education, health and Education, job skills 

parenting education, family training, job placement, 
planning, other services support services 



$3,540 per participant 
Voluntary 



Teen mothers or pregnant 
teens. 17 or younger, on 
AFDC, without high schot)l 
diploma orGBD 



Matched-sites comparison 
group, net impact 

4 site' 



60 months 



Employment, earnings, 
welfare rtveipt, 
educational attainment, 
household income, parenting 
skills, child outcomes, 
fertility 

Increasi*d employment and 
earnings; decreased welfare 
receipt; no effect on 
educational attainment or 
household income; positive 
parenting and child 
impacts; increase in live 
births 



N/A 

Voluntary 



Dropt)uts 17-21, read- 
ing below eighth-grade 
level, JTPA eligible; 
50% of females on AFEX: 
at baseline 



Random assignment, 
net impact 

13 sites 



Approximately 48 
months 

Employment, earnings, 
educational attainment, 
welfare receipt, family 
formation, criminal 
behavior 



At 12 numths: decreased 
employment and 
earnings; increased 
educational attainment; 
no impact on welfare 
receipt. Final, 1993 
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New Chance 


Ohio LEAP 


Teenage Parent 
Demonstration 


Start Date^ 


1989 


1989 


1987 


Major 

Program 

Activities 


Education, employability 
training, job skills 
training, work 
internship, family 
planning and health 
education, health 
services, parenting 
education, life skills 
training, counseling, job 
placement, on-site child 
care in most sites 


Required school attendance, 
financial incentives and 
penalties, case management, 
child care, transportation, 
guaranteed summer job 


Education, job skills 
training, job search, 
life skills instruction, 
support services, child 
support enforcement 


Net Cost^ 


N/A 


N/A 


N/A 


Mandatory 
or Voluntary 


Voluntary*; in some states 
will meet JOBS 
participation if4uirement 


Mandatory 


Mandatory 


Target 
Groups 


AFDC recipients 17-21 who 
gave birth as teens and 
are dropouts, wi«h 
children of any age 


Custodial parents on AFDC, 
under 19, without high 
s<:htK)l diploma or GED, with 
children of any age 


Teenage AFDC rv ienti 
who have 1 child 
any age or are pregnant 
with first child 


Research 
Design 


Random assignment, net 
impact 


Random assignment, net 
impact 


Random assignment, 
net impact 


Study Scale 


16 sites 


12 ot 88 counties^* 


2 sites in New Jersey; 
1 in Fllinois 


Length of 
Follow-Up^ 


36 months 


24-48 months 


24 months 


Outcomes 
Measured 


Employment, earnings, 
t^iucational attainment 
cind achievement, welfare 
receipt, fertility, 
parenting skills, child 
outcomes 


Employment, earnings, 
welfare receipt, 
educational attainment, 
health, family formation, 
attitudes 


Employment, earnings, 
welfare receipt, 
educational attainment 
and achievement, 
family formation, 
istablishment of 
paternity and child 
support, parenting skills 


Impact 
Findings^ 
(or Date 
Expected) 


Interim, 1993; final, 
1995 


Interim, 1992; final, 1995 


Interim, 1990; final, 
1992 



Uvfitimmi) 
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TABLEX4 (continued) 

Sn/wrirco^^^^^ twocategories: completed evaluaHons, 

Beginning with Job Corps, and those still in progress, beginning with JOBSTART. 

TTie start date refers to the start of intake for the research sample. 

costs reported are per experimental unless otherwise noted. These net cost estimates 

operating agency. The estimates are not stiictly equivalent across studies, primarilv due to 
differences in calculaHng the cost of services to controls. pnmariiy due to 

•^The follow-up period refers to the longest amount of follow-up available, althoueh it mav 
not apply to all groups or all measures in the study. avaiuimt, aimough it may 

h.llZ n"''' ^'^"='»""y significant impacts are reported. In a few c«es 

however findings may reflect impacts that are consistent Through the Llow-up Iri^ bu no! 

ours 'rM,'" '"""''^^ '°"°^-"P- -""''^y-^ stiidi^, im JlSi'ba^ 

^'The program opernted statewide. 
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training. The evaluations of these last two programs measure outcomes 
for children as well as mothers. The Job Corps evaluation studied the 
effects of a model combining education and training with support 
services and job placement assistance at residential sites; the JOBSTART 
Demonstration - for which data are still being analyzed - provided 
similar services to a target population of young dropouts in nonresiden- 
tial settings. All of these evaluations provide important information on 
the success of treatments intended to prevent long-term welfare receipt, 
a key goal of JOBS. 

Support Services Tests 

Welfare-to-work programs often provide support services that are 
intended to enable welfare recipients to participate in activities such as 
education, job search, and employment. Th2se support services may in- 
clude child care, medical benefits, transportation, information on family 
planningand lifeskills, counseling, and transitional benefits for a limited 
period after the welfare recipient becomes employed. Several rigorous 
evaluations have examined programs that randomly assigned partici- 
pants to groups receiving different amounts of support services. Such 
studies are the only source of experimental research on the effects of 
support services on welfare recipients' subsequent employment, earn- 
ings, and welfare receipt. 

In some of these studies, researchersmeasured theimpacts ofsupport 
services on both the mothers and their children. Research findings on 
child impacts have been carefully reviewed elsewhere (Polit and O'Hara, 
1989; Brooks-Gunn, 1989). For this reason, and because this report is 
focused on the employment-related impacts of welfare-to-work pro- 
grams, the i mpacts of support services on child ren a re not discussed here. 

The studies described in Table 3.5 examine three kinds of support 
services: child care, child-care-related instruction for new mothers, and 
transitional benefits. One study, the Expanded Child Care Options 
(ECCO) Demonstration, uses a differential impact design to compare the 
effects of child care available under New Jersey's JOBS program - 
REACH, plus up to one year of post-REACH transitional benefits - to 
two alternatives. To do this, participants will be randomly assigned to 
child care as it is normally available through REACH (and its transitional 
benefits) or to one of two alternatives: (1) child care paid for at REACH 
rates but available on a conti nuing basis, even after the participant leaves 
REACH, until the participant's youngest child enters first grade; or (2) 
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TABLE 3,5 EVALUATION STUDIES RELATED TO JOBS: 
SUPPORT SERVICES TESTS 



Abecedarian Project 



Johns Hopkins Center 
for School-Aged Mothers 



Nurse Home Visitation 
Program: Pregnancy/ 
Early Infancy 



Start Date^ 

Major 

Program 

Activities 



Net Cost 

Mandatory 
or Voluntary 

Target 
Groups 



Research 
Design 

Study Scale 

Length of 
Fol low-Up^ 

Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



1972 



N/A 



Free educational day care Comprehensive hospital- 
for children from birth based program including 



to kindergarten entry 
N/A 

Voluntary 



education; social services, 
outreach 



N/A 

Voluntary 



Teenage mothers with risk Black teenage mothers 

factors: poverty, low with infants 
education, mental 
retardation, psycho- 
social problems, etc. 

Random assignment, net Hospital comparison 

impact group, net impact 

29 families in 1 site 100 mothers in 1 site 

54 months 24 months 



Maternal welfare receipt, 
maternal education, 
fertility 

Less maternal welfare 
receipt; increased 
maternal schc « 
completion by 
experimentals; fewer 
subsequent births 



Maternal educational 
progress, fertility 



Increased school 
persistena* and gradu- 
ation; fewer repeat 
pregnanvies 



1978 

Nurse visits from child's 
birth until age 2, 
referrals to services, 
encouragement to 
resume school or work 

N/A 

Voluntary 



First-time mothers under 
19 or single or low SES, 
plus some other 
volunteers 



Random assignment, net 
and differential impacts 

400 mothers in 1 site 

46 months postpartum 



Maternal school return, 
welfare receipt, 
employment, fertility 

For poor single mothers: 
smaller or no impacts on 
schooling and welfare; 
82% more months 
worked; 43% fewer 
pregnancies 
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TABLE 3.5 (continued) 





Teenage Pregnancy 
Intervention Program 


Expanded Cbild Care 
Options (ECC.O) 
Dr .nonstration 


Illinois Career Advance- 
ment Demonstration 


Sttirt Date^ 


1979 


1990 


1989 


Major 

Program 

Activities 


Home visits providing 
child care instruction, 
training as nursery aides 


Test of 3 progranfs: 
(1) high-quality develop- 
mental child care and 
parenting support until 
youngest child enters 
first grade; (2) regular- 
quality, welfare agency- 
subsidized child care 
uniu yuungeai (.riuu eniers 
first grade; (3) regular- 
uuaiiiy, welfare agenty- 
subsidized child care while 
parent is in JOBS plus up 
to 1 ir^tmiticinAl x/oar 


Payment for training- 
related expenses 
(transportation, child 
care, fees other than 
tuition), materials paid 
to $300 


Net Cost 


N/A 


N/A 


N/A 


A n rl A Irt t*v 

or Voluntary 


V UlUlllal y 


ividiiuuiui y vuui Lllliu Ldiu 

»s offered, not required) 


viiiuiiiciiy 


Groups 


with infants 


APOC r*>rinients wit^h a 

it I L^X_ 1 1. V.1 L/IV 1 IVO Willi C4 

child under 3 


Pnrmor tA/t^lfArp rprinipntct 
Wviidic i i-v.i|^idii3 

earning less than 185% of 
standard of ner.d 


Research 
Design 


Random assignment, net 
and differential impacts 


Random assignment, net 
and differential impacts 


Random assignment, 
net impact 


Study Scale 


120 mothers in 1 site 


1,8(X) families in urban 
New Jersey 


Statewide 


Length of 
Follow-Up^ 


24 months 


15 years or more 


60 months 


Outcomes 
Measured 


Repi»at pregnancies, return 
to school or work 


Maternal employment, 
earnings, welfare receipt 
and payments, use of 
education and training, 
use of child care 


Employment, earnings, 
welfare receipt and 
payments. Medicaid 
receipt. Food Stamps 


Impact 
Findings^ 
(or Date 
Expected) 


Training reduced repeat 
pregnancies and speedtnl 
return to school or work; 
home visits had similar, 
but smaller, impacts 


N/A 


N/A 
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TABLETS (contwued) 



Memphis Nurse North Carolina 

Home Visitation Montgomery County, Guaranteed Child Care 

Program Ohio, Demonstration Demonstration 



Start Date^ 



1990 



1989 



1988 



Major Test of 2 programs: nurse 

Program visits for group 1 during 

Activities pregnancy, for group 2 

until child is 2; 

referrals to services; 

encouragement to resume 

school or work 



TransiHonnl Medicaid and 
child care (effective 
VI /9(), controls also could 
receive these services); 
mandatory assessment; 
access to employment- 
related activities 



Offer of a guarantee of 
transitional child care, 
compared to transitional 
child care on a space- 
available basis 



Net Cost 

Mandatory 
or Voluntary 

Target 
Groups 



Research 
Design 



N/A 

Voluntary 



Disadvantaged first-time 
mothers; oversampling 
women under 18 



N/A 

Mandatory 



AFDC recipients with 
children under 6 



Random assignment, net Random assignment, net 
and differential impacts impact 



N/A 

Voluntary 



AFDC recipients with 
children 1-5 



Random assignment, 
net impact 



Study Scale 

Length of 
Pol low-Up^ 

Outcomes 
Measured 



Impact 
Findings;*' 
(or Date 
Expected) 



Over 1,4(X) mothers in 1 county 
Memphis 

24 months postpartum 48 months 



Maternal education, 
employment, welfare 
receipt. Medicaid, Food 
Stamps, fertility, health 
habits, infant care, 
service use 

Reports: 1995, 1997, 1998 



1 county 



12 months 



Employment, earnings, job Employment, welfare 
characteristics; welfare receipt and payments 
receipt, duration, and 
recidivism; Medicaid and 
child support payments, 
family formation 



Interim, 1990, 1991,1992; 
final, 1993 



1990 



(cotithiued) 
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TABLE 3.5 (continued) 



Texas Transitional Child 
Care and Medicaid Study 



Wisconsin Income Disregard 

and Transitional Medical Benefits Study 



Start Date^ 

Major 

Program 

Activities 



Net Cost 

Mandatory 
or Voluntary 

Target 
Groups 



Research 
Design 

Study Scale 



Length of 
Follow-Up^ 

Outcomes 
Measured 



Impact 
Findings^ 
(or Date 
Expected) 



1989 

Offer of extended 
transitional child care 
and Medicaid benefits for 
those who become employed 
(effective 4/1/90; 
controls also could 
receive these services) 



N/A 

Mandatory 



AFDC applicants and 
recipients) (age of 
youngest child not 
specified) 

Random assignment, net 
impact 

Statewide; 90,000 
applicants and recipients 
offered 12 months of 
transitional benefits; 
10,000 applicants and 
recipients offered 4 
months of transitional 
benefits; lx)th groups 
offered 12 months of 
transitional benefits 
effective 4/1/90 

36 months 



Kmployment, earnings, 
child care use and cost, 
welfare receipt, 
payments, and recidivism 

1993 



N/A 

Test of incentives for leaving welfare: 1 year 
of extended Medicaid eligibility for those 
who become employed vs. a revised 
income disregard for those who become 
employed while on welfare vs. status quo 
(effective 4/1/90, FSA transitional 
benefits were made available to all persons 
affected by the research) 

N/A 

Mandatory 



Current and new AFIXT 
recipients with children 3 
months or older 



Random a.ssignment, 
differential impact 

N/A 



N/A 



Employment, earnings, 
welfare receipt and 
payments Medicaid receipt, 
job retention 

N/A 



(cotithttwd) 
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TABLE 3.5 (continued) 

NOTES The programs^ are organized alphabetically within two categories: completed evaluations, 
beginning with the Abecedarian Project, and those still in progress, beginning with the Expanded 
Child Care Options (ECCO) Demonstration. 

^he start date refers to the start of intake for the research sample. 

^lie follow-up period refers to the longest amount of follow-up available, although it may not 
apply to all groups or all measures in the study. 
^Only statistically significant impacts are reported. 
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high-quality, developmental child care and parenting sup|X)rt; aiso 
until the youngest child enters first grade. Another study, the Abece- 
darian Project; measured the net impact of high-quality educational 
day care compared to the child care arrangements made by control 
group members. 

Four studies examine the effects on mothers' employment of 
providing instruction to new n\others on child care and related issues. 
These studies use visiting nurses and hospital staff to help women learn 
how to gain access to child care and other resources that they need in 
order to return to school or work. These are net impact studies; members 
of the control group or comparison group do not have access to the child 
care instruction program. 

Five states are currently completing random assignment studies of 
pre-FSA transitional support services for former AFDC recipients. In 
Illinois, a study is analyzing the effects of reimbursing some 
training-related expenses incurred by former welfare recipients who 
seek to upgrade their vocational skills. North Carolina offered a guaran- 
tee of access to transitional child care to persons leaving AFOC; the 
members of the control group received no guarantee, but were eligible to 
receive child care if slots were available. Studies in Texas and Ohio 
examine the effects of extending transitional child care and Medicaid. 
Wisconsin is conducting a comparison of two incentives to leave wel- 
fare: a change in the earned income disregard (permitting welfare 
recipients to remain on welfare and receive part of their welfare benefits 
for up to one y»?ar when they accept employment) and the provision of 
one year of extended Medicaid coverage for those who become em- 
ployed. When Ihe FSA transitional benefits took effect on April \, 
1990/ they were extended to cover all members of the experimental 
and control groups in these states. 



STUDIES OF WELFARE-TO-WORK PROGRAMS 



References for Evaluation Studies 
Discussed in Chapter 3 

Abecedarian Project 

Campbell, Frances A.; Breitmayer, Bonnie; and Ramey, Craig T. 1986. "Disadvantaged 
Single Teenage Mothers and Their Children: Consequences of Free Educational Day 
Care/' Family Relations, 35(1): 63-68. 

AFDC Homemaker-Home Health Aide Demonstrations 

Bell, Stephen H.; Burstein, Nancy R.; and Orr, Larry L. 1987. Overview of Evaluation Results: 

Evaluation of the AFDC Homemaker-Home Health Aide Demonstrations, Cambridge, 

Mass.: Abt Associates Inc. 
Bell Stephen H.; Enns, John H.; and Orr, Larry L. 1986. 'The Effects of Job Training and 

Employment on the Earnings and Public Benefits of AFDC Recipients: The AFDC 

Homemaker-Home Health Aide Demonstrations." Draft. Paper presented at the 

Annual Research Conference of the Association for Public Policy Analysis and 

Management, Austin, Texas. 
Bell, Stephen H.; and Orr, Larry L. 1988. "Screening (and Creaming?) Applicants to Job 

Training Programs: The AFDC Homemaker-Home Health Aide Demonstrations." 

Paper presented at the Annual Research Conference of the Association for Public 

Policy Analysis and Management, Seattle, Washington. 
Cella, Margot. 1987. Operational Costs of Demonstration Activities: Evaluation of the AFDC 

Homemaker-Home Health Aide Demonstrations, Cambridge, Mass.: Abt Associates Inc. 

Arkansas WORK Program 

Friedlander, Daniel; Hoerz, Gregory; Quint, Janet; and Riccio, James. mSb, Arkansas: Final 
Report on the WORK Program in Tiw Counties, New York: MDRC. 

Baltimore Options 

Friedlander, Daniel. 1987. Maryland: Supplemental Report on the Baltimore Options Promm, 
New York: MDRC. 

Friedlander, Daniel; Hoerz, Gregory; Long, David;and Quint, Janet. mbaMaryland: Final 
Report on the Employment Initiatives Evaluation, New York: MDRC. 

California GAIN 

Riccio, James; Goldman, Barbara; Hamilton, Gayle; Martinson, Karin; and Oronstein, Alan. 
1989. GAIN: Early Implementation Experiences and Lessons, New York: MDRC. 

Cook County WIN Demonstration 

Friedlander, Daniel; Freedman, Stephen; Hamilton, Gayle; and Quint, Janet. 1987. Illinois: 
Final Report on Job Search and Work Experience in Cook County, New York: MDRC. 

Expanded Child Care Options (ECCO) Demonstration 

NewJerseyDepa^tmentofHumanServices.l989.C;«WCflrrP/Hs.vlDt»mo/^s/ 

Child Care Options for Loio-lncome Families, Draft Report. Trenton: New Jersey Depart- 
ment of Human Services. (ECCO was previously known as Child Care Plus.) 

Florida Project Independence 

Manpower Demonstration Research Corporation. 1989. Unpublished internal documents. 
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Food Stamp Employment and Training Program 

Puma, Michael; Werner, Alan; and Hojnacki, Marjorie. 1988. EiHiluation of the F> )d Stamp 
Employment md Traittitij^ Program: Report to Cofij^ress oti Program Impkmentatm. 
Cambridge, Mass.: Abt Associates Inc. 

Illinois Career Advancement Demonstration 

Interagency Low Income Opportunity Advisory Board, Executive Office of the President, 
(no date). Special Terms and Conditions. Unpublished internal document. 

Illinois Early Access Program 

Interagency Low Income Opportunity Advisory Bonrd, Executive Office of the President, 
(no date). Special Terms and Conditions. Unpublished internal document. 

Job Corps 

Mallar, Chark»s; Kerachsky, Stuart; Thornton, Craig; and lx)ng, David. 1982. Project Report: 
Eifaliiation of the Economic ImiHict of the job Corps Program, Third Follow-Up Report. 
Princeton, N.J.: Mathematica Policy Research, Inc. 

job Corps Computer-Assisted Instruction Evaluation 

ShugoU Research; BattelleHuman Affairs ResearchCenters;and Kearney /Centaur Division, 
A. T. Kearney, Inc. 1989. job Corps Computer- Assisted Instruction Pilot Project EiHiluation. 
Report prepared for the U.S. Department of Labor. Bethesda, Md.: ShugoII Research. 

JOBSTART 

Auspos, Patricia; Cave, CJeorge; lXK)littIe, Fred; and Hcwrz, Gregory. 1989. Implementing 
lOBSTART: A Demonstration for School Dropouts in the JTPA System. New York: MDRC. 

Johns Hopkins Center for School-Aged Mothers 

Hardy,). B.;King,T.M.;Shipp,D.A.;andWeIcher,D.W. 1981. "A Comprehensive Approach 
to Adolescent Pregnancy." In K. G. Scott, T. Field, and E. Robertson, eds.. Teenage 
Parents and Their Offspring. New York: Grune & Stratton. 

Louisville WIN Laboratory Experiment: Group Job Search 

Gould-Stuart, Joanna. 1982. Welfate Women in a Group job Sem h Program: Their Exiurienees in 
the Lmisville WIN Research Liboratory Project. New York: MDRC. 

Wolfhagen, Carl. 1983. job Search Strategies: Lessons from the Imisville WIN Ijiboratory. New 
York: MDRC. 

Louisville WIN Laboratory Experiment: Individual Job Search 

Goldman, Barbara. 1981 . Impacts of the Immediate job Search Assistance Experiment. New York: 
MDRC 

Wolfhagen, Carl. 1983. job Search Strategies: Ussons from the Lmisville WIN Uboratorxf. New 
York: MDRC. 

Maine OJT 

Auspos, Patricia; Cave, C;a)rge; and Long, David. 1988. Maine: Final Report on the Training 
Opimtunities in the Private Sector Program. Now York: MDRC. 

Massachusetts ET Choices 

Nightingale, Demetra Smith; Burbridge, Lynn C; Wissoker, Douglas; Bawden, Lee; 
Sonenstein, Freya L.; and Jeffries, Neal. 1989. Fxthriencesof Massachusetts ET job Finders: 
Preliminary Findings. Washington, D.C.: Urban Institute. 
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Memphis Nurse Home Visitation Program 

Olds, David L.; Belton, Jann; Cole, Robert; Foye, Howard; Helberg, June; Henderson, 
Charles R., Jr.; James, David; Kitzman, Harriet; Phelps, Charles;Sweeney, Patrick; and 
Tatelbaum, Robert, (no date). Nurse Home'Viaitatiott for tAothera and Children: A Research 
Proposal, Unpublished document. Rochester, N.Y.: New Mothers Study, . artment 
of Pediatrics, University of Rochester. 

Minority Female Single Parent Demonstration 

Gordon, Anne; and Burghardt, John. 1990. The Mitiority Female Sin^^le Parettt Deffionstratiofi: 
Short-Term Ecotwmic Impacts, New York: Rockefeller Foundation. 

Montgomery County^ Ohio, Demonstration 

Bell, Stephen H ; and Fein, David J. Forthcoming. Ohio Transitiofis to Independence 
Demonstration : Program Impacts in the First Fiscal Year, Cambridge, Mass. : Abt Associates 
Inc. 

Hollenbeck, Kevin; Hufnagic, John; and Kurth, Paula. 1990a. Implementation of the JOBS 
Proj^ram in Ohio: A Process Study, Second Annual Report. Columbus: Ohio State 
University, Center on Education and Training for Employment. 

Hollenbeck, Kevin; Hufnagle, John; and Kurth, Paula. 1990b. Implementation of the JOBS 
Program in Ohio: A Process Study, First Annual Report. Columbus: Ohio State Univer- 
sity, Center on Education and Training for Employment. 

National JTPA Study 

Bloom, Howard; Orr, Larry; Doolittle, Fred; Hot?., Joseph; and Barnow, Burt. 1990. Design 
oftheNatiomI JTPA Study. Washington, D.C.: Abt Associates Inc. and MDRC. 

Doolittle, Fred; and Traeger, Linda. 1990. Implementing the National JTPA Study, New York: 
MDRC. 

National Supported Work Demonstration 

Board of Directors, Manpower Demonstration Research Corporation. 1980. Summary and 
Findings of the National Supported Work Demonstration, New York: MDRC. 

New Chance 

Quint, Janet C; and Guy, Cy n thia A. 1 989. Neio Chance: Lessons from the Pilot Phase, New York: 
MDRC. 

New Jersey OJT 

Freedman, Stephen; Bryant, Jan; and Cave, Cieorge. 1988. Neiv Jersey: Final Report on the 
Grant Diversion Project. New York: MDRC. 

New Jersey REACH 

Mathematica Policy Research, Inc. 1988. RFACll Welfare Initiative Program Evalualion: Tcclh 
nical Proposal, I^rinceton, N.J.: Mathematica I'olicy Research, Inc. 

New York State Comprehensive Employment Opportunity Support Centers (CF.OSC) 

Werner, AIan;and Nutt-l*owell, Bonnie. 1988. Evaluation of the Comprehensive EmpLtyment 
Oppiirtunity Support Centers, Vol. J: Synthesis of Findings. Cambridge, Mass.: Abt 
Associates Inc. 

North Carolina Guaranteed Child Care Demonstration 

North Carolina [department of Human Rc*sources. (no dale). Child Care Rayi'ling Fund 
Demonstration Project: Pretest and Evaluation. Unpublished internal document. 
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Nurse Home Visitation Program: Pregnancy/Early Infancy 

Olds, David L,; Henderson, Charles R., Jr.; Tatelbaum, Robert; and Chamberlin, Robert. 
1988. "Improving the Life-Course I> jlopment of Socially Disadvantaged Mothers: 
A Randomized Trial of Nurse Home Visitation." Amencan ]onrml of Public Health, 
78(11): 1436-1445. 

Ohio LEAP 

Long, David; and Bloom, Dan. 1989. Dei;igti of the Project Leant Evaluation. Unpublished 
document prepared for the Ohio Department of Human Services. New York: MDRC. 
(LEAP was previously known as Project Learn.) 

Ohio Transitions to Independence Evaluation 

Bell, Stephen H.; Hamilton, William L.; and Burstein, Nancy R. 1989. Ohio Trattsitiotts to 
Independence Evaluation: Design of the CostSenefit Analysis. Cambridge, Mass.: Abt 
Associates Inc. 

Pennsylvania Saturation Work Program 

Hogarth, Suzanne; Martin, Roger; and Nazar, Kathlwn. 1989. Penn$\flvania Saturation 
Work Program Impact Evaluation, Draft Report. Harrisburg, Pa.: Department of Public 
Welfare. / 

Project Redirection 

Polit, Denize; Quint, Janet; and Riccio, James. 1988. The Ckillenge of Serving Teenage Moth- 
ers: Lessons from Project Redirection. New York: MDRC. 

Riverside, California, Case Management Study 

Manpower Demonstration Research Corporation. 1988. RcM^arch Design for a Sfkrial Study 
of Case Management in the Riverside County GAIN Program. Unpublished internal 
document. 

San Diego I (EPP/EWEP) 

Goldman, Barbara; Fried lander, Daniel; and U)ng, David. 1 986. Cfl/i/urMw; FiM^^ 
San Diego lob Search and Work Experience Demonstration. New York: MDRC, 

San Difgo SWIM 

Hamilton, Gayle; and Friedlander, Daniel. 1 989. Final Report on the Saturation Work Initiative 
Model in San Diego. New York: MDRC. 

SIME/DIME Manpower Experiment 

Hall, Arden R. 1980. "Education and Training." In Philip K. Robins, Robert G. Spiegelman, 
Samuel Weiner, and Joseph G. Bell, eds., A Guaranteed Annual Income: Evidence from a 
Social Experiment. New York: Academic Press. 

SRI International. 1983. Final Report on the Seattle-Denver Income Maintenance E.xpcriment, 
Volume I: Design and Results. Menio Park, Ca.: SRI International. 

Teenage Parent Demonstration 

Hrrshey, A.; and Nagatoshi, C. 1989. Implementing Senncesfor Welfare Dependent Teenage 
Parents: ExiKriences in the DHHS/OFA Teenage Parent Demonstration. Prepared for the 
Department of Health and Human Services. Princeton, N.J.: Mathtanatica Policy 
Resciirch, Inc. 



J 4 (I 



STUDIESOF mLFARE'TO-mRK PROGRAMS 



Teenage Pregnancy knterveniion Program 

Field, T.; Widmayer, S.; Greenberg, R.; and Stoller, S. 1982. "Effects of Parent Training on 
Teenage Mothers and Their Infants." Pediatrics, 69: 703-707. 

Texas Transitional Child Care and Medicaid Study 

Interagency Low Income Opportunity Advisory Board; Executive Office of the President, 
(no date). Special Terns and Conditions, Unpublished internal document. 

Virginia ESP 

Friedlander, Daniel. 1988a. "An Analysis of Extended Follow-Up for the Virgin- 
ia Employment Services Program." Unpublished internal document. New York: 
MDRC. 

Riccio, James; Cave, George; Freedman; Stephen; and Price; Marilyn. 1986. Virginia: Final 
Report on the Employment Services Program. New York: MDRC. 

Washington FIP 

Urban Institute. 1989. FAHiluatioti Design for the Family Independence Program: Third Draft. 
Prepared for the Legislative Budget Committee, State of Washington. Washington, 
D.C: Urban Institute. 

West Virginia CWEP 

Fried lander, Daniel; Erickson, Marjorie; Hamilton, Gayle; and Knox, Virginia. 1986, We<it 
Virginia: Final Report on the Community Work Experience Demonstrations. New York: 



Wisconsin Income Disregard and Transitional Medical Benefits Study 

Interagency Low Income Opportunity Ad visoiy Board, Executive Office of the President, 
(no date). Special Terms and Conditions. Unpublished internal document. 
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Chapter 4 



The Knowledge Base: 
Broad-Coverage Programs 



Chapter 2 presented a conceptual structure for understanding how JOBS 
programs can affect behavior and for organizing this synthesis. Chapter 
3 identified the relevant completed and current studies, pointed to the 
outcomes that they address, and summarized the research designs. This 
chapter and the next discuss what we do and do not know about the 
effectiveness of different welfare employment program designs and com- 
ponents for different populations' and the information likely to emerge 
from current research. These two chapters basically follow the organiza- 
tion of Chapter 3 and discuss the following topics; 

• Broad-Coverage Programs 

• Selective- Voluntary Programs 

• Subgroups and Targeting 

• Education Si^rvices 

• Youth-Oriented Services 

• Support Services Tests 

• Program Model Combinationti 

This chapter presents the findings on broad-coverage welfare-to-work 
programs. 

As indicated in Table 3.1, there are a substantial number of studies of 
broad-coverage, mostly mandatory WIN (and now JOBS) programs, 
some of which were implemented on a relatively small scale, while others 



For other summaries of the recent research on the effectiveness of welfare-to-work 
programs, see Barnow, 1987; Burtless, 1989; U.S. Congressional Budget Office, 1987; 
Clrossman, Maynard, and Roberts, 1985; Friedlander and Cueron, forthcoming; Cuer- 
on, 1987, 1991); (iueron and U)ng, 1990; Interagency Low Income Opportunity Advisory 
Board, Executive Office of the President, 1988; Porter, 1990. 
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targeted all eligibles ard were statewide. At this time, impact and 
cost-effectiveness result? are available only from seven studies of a 
range of low- and moderate-cost programs in Arkansas, Baltimore, 
Cook County (Illinois), San Diego (San Diego and SWIM), Virginia, 
and West Virginia.^ These findings are of particular relevance. They pro- 
vide information on impact? for a cross section of the then-mandatory 
caseload and assess total WIN systems (either at full or smaller scale) 
that, to varying degrees, imposed a participation requirement. The pro- 
grams reflect the range of average resources per eligible person likely to 
be available in most statsi' implementing JOBS, and they represented 
different approaches and philosophies, from the very modest Arkan- 
sas and Cook County programs to the more complex (and JOBS-like) 
Baltimore Options and San Diego SWIM demonstrations, both of which 
included some form of education and training, case management, and 
assessment. They were clearly pre-JOBS, however, in requiring partici- 
pation only of single parents with children over age 5,^ in usually empha- 
sizing immediate job placement over human capital development, and 
in the work incentives and support services they provided. 

The studies show that these programs were usually successfully 
implemented and imposed obligations on a significant share of the 
targeted welfare caseload. Most of the programs led to a substitution of 
earnings for welfare, had durable impacts, and were cost-effective with- 
in a relatively short period of time. 

The next five sections discuss the lessons from the seven studies 
about program participation, impacts, and costs versus benefits. They 
are followed by four sections that summarize what is known about the 
relationship between the dimensions noted inChap^ei 2- e.g., particular 
employment-directed services, program cost (and cost-effectiveness), 
service sequencing, administrative practices, and coi;textual factors - 
and a program's impacts on employment and welfare receipt. 



As noted in Chapter 3, Snn Diego I participation and impact findings are reported for the 
job search /work expi»rience st.»quence. 

^ Results are also available from the Louisville job stvirch experiments, but they are 
discussed more briefly since they are from an e»irlier period nnd thus less relevant than 
some of the later, liimilar programs. 

As indicated in Chapter 3, Arkansas mandated participation for women with children 
age 3 or older. 
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Findings on Participation and Implementation 

As noted in Chapter 2, some level of program participation (or 
behavior to avoid participation) is a precondition for mandatory pro- 
grams to have an impact. Mandated participation can result in employ- 
ment and welfare effects through three mechanisms. First/ public assis- 
tance recipients who take part in such programs may be helped to find 
jobs and exit the welfare rolls. Second, if participation requirements 
are enforced, individuals who fail to comply with them may have their 
grants reduced or terminated, resulting in direct welfan savings. Third, 
imposition of a quid pro quo for welfare receipt may deter some individ- 
uals from remaining on welfare or from filing or completing an initial 
application for assistance. 

This section briefly summarizes findings on participation and 
sanctioning as a basis for understanding the comparability of the find- 
ings on broad-coverage and selective-voluntary programs and for iden- 
tifying the remaining open questions. 

Most of the findings on participation come from the seven evalua- 
tions noted above. These studies presented two different concepts of 
participation: longitudinal measures (which showed the proportion of 
program registrants who ever reached a given activity milestone within 
a specified period of time)^ and monthly participation rates (which 
showed the percentage of those eligible for the program in any given 
month who were actually active during that month). Longitudinal mea- 
suresdescribe the ''careers'' that individual registrants have in a program. 
Thus, they help characterize the nature of the treatment being evaluated. 
Monthly participation rates reflect the aggregate level of activity, but do 
not indicate whether the same or different people are active. Both rates 
are influenced by the characteristics of the participants, the obstacles to 
participation, AFDC grant levels (and ihus the extent to which people 
combine work and welfare), program policieson deferral and exemption, 
and the extent of outreach and enforcement. 

Both of these participation measures differ fundamentally from ^he 
concept of countable participation introduced in the JOBS regulations, 
since they include as participants anyone who was active for at least a 



Longitudinal measures thus focus on the same cohort of registrants over a specified period 
of time. 
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day or hour (although usually substantially more) in a major program 
component (not counting registration, orientation, assessment, or coun- 
seling) in the designated period. In contrast, for purposes of receiving 
an enhanced federal match, JOBS includes as participants only those 
people who are active at least 75 percent of scheduled hours; in addition, 
the group of individuals counting toward the state's participation rate 
must, on average, be scheduled for 20 hours of participation a week. As 
noted below, the JOBS participation rate also differs in the people and 
activities included or excluded in the numerator or denominator. 

Table 4.1 shows the longitudinal indicators for AFDC case heads 
targeted by the seven programs. (Rates for AFDC-UP case heads are 
quite similar.) The numerators and denominators in these rates are, 
respectively, those participating and the total number of people targeted 
by the program. In some cases, this latter number included all 
WIN-mandatory cases newly referred to the program; in others, it was 
only applicants or a subset of the caseload (e.g., 1,000 people in Baltimore 
[see Chapter 3]). This is an important distinction, because it costs money 
to monitor participation and provide services, and participation rates 
would have been lower if the same funds had been spread over a 
larger caseload. 

The broadest indicator (row 1) shows that, withm nine or twelve 
months after registration, between 38 and 64 percent of all targeted cases 
took part in a specific activity scheduled by the program.^ Participation 
was lowest in Arkansas and Cook County, and highest in SWIM.'' The 
other rows show the actual activities i*^ which individuals participated. 



^Row 1 includesallindividuiils whoptirticipated for.it lenst one hour inn specific approved 
program comptment (e.g., job search, work experience, education, or training). (The 
minimum measure varied by state from one hour in SWIM and one day in Arkansas, C(H)k 
County, San Diego, Virginia, and West Virginia to three days in Baltimore. But people 
usually participattKi much longer.) Assessment, orientation, jobplacement,and counseling 
are not counted as "participation" in this table. 

Participation rates are not always directly comparable because of differences in the 
ItKation of random assignment, which was either at the income maintenance or program 
office (see the notes to Table 4.1). The SWIM study differt^d in having random assignment 
at the program office, which was not co-located with the income maintenance office. Thus, 
measured ratt»s would have been lower in SWIM if random assignment had been at the 
same point as in the other studies. Further, in Arkansas, he composition of the sample 
provided one reason for the low participation rate. Sixty pt i cent of the sample members 
were new applicants for AFDC and almost 41) percent of them did not ultimately get on 
welfare (i.e., have their grants approved). Thus, they became deregistered from the 
program relatively rapidly and had little opportunity to participate. (See Friedlander 
et ah, 1985b.) 
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^ TABLE 41 PERCENT OF AFDC ELIGIBLES EVER INVOLVED IN SPECIFIED ACTIVITIES 
WITHIN NINE OR TWELVE MONTHS AFTER RANDOM ASSIGNMENT, 
FOR SEVEN WELFARE-TO-WORK PROGRAMS 



Activity Measure? 



Arkansas 



Job Search; 
Work 

Experience 



ParticipatL»d in Any 

Activity {%) 3a 0 
Participated in;^ 

job Search Activities (%) 273^ 

Work ExptMience {7, ) 2.9 

Other Services, including 

Education and Training (%)^ N/A 

Deregistered ( % ) 575 

Due to Requi.»st for 

Sanctioning {%) \/A'' 



Baltimore 



Multi- 
Component 



Foiiow-Up Period in Months 



45.0 

24.7 
17.5 

17.3 
37.6 

!ow^' 
12 



Cook County San Diego I 



Job Search; 
Work 

Experience 



3«.8 

36.1 
7.3 

4.1 
56.9 

12.4 



Job Search; 

Work 

Experience 



46.4 

44.1 
13.0 

N/A 
60.6 

8,0 



San Diego 
SWIM 



Job Search; 
Work 

Experience, 

Education; 

Training 



64.4 

50.6 
19.5 

24.3 
61.5 

10.6 



Virginia 



Job Search; 

Work 

Experience 



58.3 



51,0 



11,6 
42.3 

3.8 



West 
Virginia 



Work 
Experience 



N/A^ 

N/A^ 
23.9 

N/A' 
42.3 

1.8 



12 
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SOURCES; Data from Friedlander et al., 1985b; Fried landerj 987; Friedlander et al., 1987; Goldman, Friedlander, and Long, 1986; Hanilton, 1988; Riccio 
et al., 1986; Friedlander et al., 1986. 

NOTES: EsHmates are for AFDC applicants and recipients in all locations except San Diego I, which included only applicants. In SWIM, percentages were 
calailated usinga base of all eligibles who registered in the program; in Baltimore, CookCounty, San Diego land Vir 

In Arkansas and West Virginia, the base include, all registrants; however, since the program office and income maintenance office were co-located in both 
these states, there is probably little difference between the number of people registered and the number eligible but not registered. 
*West Virginia's program consisted almost exclusively of work experience. 

N/A under participation components indicates that such components were nut available in the program. 
^Participation in the individual job search component of the Arkansas :'2monstration is not included here. 
Includes only education and job skills training that were either provided or approved by the programs. Individuals in all seven programs also 
undertook other education and job skills training. Available data suggest that the experimental-control difference in participation in these -xwices is 
substantially smaller than the experimental participation rates shown. 

*^Vhile the percent of sample members deregistered owing to a request for sanction is not available in Arkansas or Baltimore, other data suggest that 
sanctionmg was limited. In Baltimore, a special case file study was done of 70 enrollees initially assigned to a program component (or assigned after being 
m a short-term holdingstatus) who did not attend activities for which they were scheduled. The review indicated that only three of the 70 enrollees were 
deregistered for noncompliance and that none of the 70 had a financial penalty imposed on them. Administrative records maintained by the Arkansas 
Department of Social Services indicate that in the two counties studied, 3 and 5 percent of persons in the full caseload (not just the sample) participating 
in an assessment were sanctioned or deregistered due to noncompliance. 
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As described in Chapter 3, in all of the programs except West Virginia 
and Baltimore, job search was usually the first in a fixed sequence of ac- 
tivities, followed by work experience. The table shows that the majority 
of participants were typically not active in subsequent components.* For 
example, while half of all eligibles in San Diego's SWIM initiative 
participated in job search, about a fifth were active in work experience. 

In Baltimore and SWIM, a substantial share of eligibles (17 and 24 
percent, respectively) were active in educatii)n and training, two servic- 
es of particular relevance to JOBS. (The SWIM study, which had more 
detailed data, also showed that the program increased experimentals' 
participation - when compared to that of the control group - in both 
education and training. It also found that about half of the SWIM edu- 
cation and training participation was in self-initiated education that was 
usually an alternative to, rather than sequenced after, job search.)'' 



These rates are comparable to those found in the earher study of the Employment 
Opportunity Pilot Project (EOPP), which provided a sequence of intensive job search 
assistance followed by a subsidized public service job or training to AFDC applicants and 
recipients with child jn age 6 or older. About two-thirds of those who enrolled in EOPP 
actually participated in the program. About 15 percent of enrollees (one-quarter of those 
who participated in the job search component) left job search assistance and went into 
EOPP-subsidized work positions. (See Brown et aL, 1983; Zimmerman et al., 1983.) 

^ Table 4.1 shows average longitudinal activity rates in program-provided or program- 
appro vtni services for AFDC applicants and recipients randomly assigned to theexperimenta I 
group. (Experimentals also took part in activities not provided or approved by the 
welfare- to-work program.) While membei-s of the control group did not participate in the 
programs being evaluated, a substantial number did participate on their own in activities 
provided through other programs and, in some cases, were also sanctioned. (In San Diego 
I, West Virginia, and Baltimore, controls were in the "regular" WIN program, which 
continuLHi to operate during the study period but provided substantially less service than 
thebroad><overageprogramsbeingevaluated.) In sites withsubstantialcontrol participation, 
the experimental-control difference in service receipt was smaller than suggested by the 
table. 

The level of services received by controls is particularly important in interpreting row 4 
of Table 4.1, since, in the cases where data are available, almost no controls participated in 
pb search or work experience. While data on controls' receipt of education and training are 
not available for Baltimore, they are for SWIM (although over a different follow-up and 
usingdifferentdatasourcesfromthoseusedinTable4.1).Duringatwo-tothree-yearperiod 
afterrandomassignment,34pera»nt of experimentals participated in program-approved or 
other community college programs, but so did 28 percent of controls. There were also sig- 
nificant differences in participation in JTPA-funded activities. Thus, while at a lesser rate 
than suggested by Table 4.1, SWIM did lead to a significant increase in enrollment in both 
education and training programs (Hamilton and Fried lander, 1989). In contrast, the Vir- 
ginia and Cook County studies found almost equivalent levels of participation in educa- 
tion and training for experimentals and controls. Thus, the Virginia and Cook County 
studies compared two groups that differed primarily in their receipt of job search and work 
experience, not education and training (Riccio et al., 1986; Friedlander et al., 1987). 
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The discussion of welfare dynamics in Chapter 2 helps explain why 
no program can achieve a participation rate even close to 100 percent and 
why a significantly smaller proportion of eligibles will be involved at 
each succeeding program stage. It also suggests why a 40 or 65 percent 
"ever active" longitudinal rate does not mean that the remaining 35 to 60 
percent of the caseload was untouched or overlooked by the program. 
Quite the contrary: The evaluations cited concluded that, to get these 
levels of participation, program staff had to contact, pursue, and thus 
spend resources on a much larger number of people.'" The explanation 
for these statements comes from the several different reasons for 
iionparticipation. 

First, many cases were temporarily deferred from participation 
requirements because of part-time employment," illness, or other 
circumstances recognized by the program; these situations could easily 
have lasted throughout the nine- or twelve-month follow-up period. 
Second, welfare turnover and other behavior meant that as time passed 
38 to 62 percent of people in the program became ineligible for and were 
thus deregistered from the program (row 5 of Table 4.1). They were 
deregistered because they left welfare (as part of normal turnover or to 
avoid program requirements) or for other reasons, such as havinga child 
or getting a full-time job but remaining on the rolls. (Some of those 
deregistered were sanctioned, as indicated in the last row of Table 4.1 . 
This would have directly resulted in welfare savings even if the person 
never participated in the program.) Finally, there will always be some 
cases that are "lost" and not reached by a program's mandate owing to 
lack of staff follow-up or inadequate case management and monitoring. 

In order to isolate the last factor and determine the extent to which 
the programs reached those who were actually eligible, these studies 
included a second longitudinal measure. It showed that within nine or 
twelve months of registration, between 75 and 97 percent of the eligibles 
in the seven programs had, in some sense and at some time, satisfied the 
program mandate (if not through participation, then by getting a job or 



In the SWIM FX-monstration, the evaluators concluded that program st.iff worked with 
almost the entire caseload to achieve a 64 percent longitudinal participation rate. 

" For example, in SWIM, 12-month activity rates increased from the 64.4 percent shown in 
Table 4.1 to 77.3 percent if part-time work (15 to 30 hours per week) is also counted 
(Hamilton, 1988). 
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leaving welfare) or had their welfare grant reduced. Only 3 to 25 percent 
of eligibles remained completely "uncovered'' by the program mandate.^^ 

Two of the studies were of programs specifically funded to test 
ongoing participation requirements and the maximum feasible rates of 
monthly participation: San Diego's SWIM Demonstration (for AFDCs 
and AFDC-UPs) and West Virginia's workfare program for fathers in 
AFDC-UP cases.^^ The more exhaustive SWIM study measured the per- 
cent of people active in program-approved components during any 
month and also the percent of cases participating in other activities (e.g., 
part-time employment) that satisfied the program objectives. As illus- 
trated in Figure 4.1, during a typical month in its second year, SWIM 
involved 52 percent of AFDC and AFDC-UP registrants either in the 
program (22 percent in program-arranged activities and another 11 
percent in self-initiated education or training activities) or in part-time 
work (19 percent). (See Hamilton, 1988.) The West Virginia AFDC-UP 
program achieved monthly participation rates averaging over 60 percent 
(Friedlander et al., 1986). Both studies included a careful examination of 
nonparticipants and determined that most of the people ,vho did not par- 
ticipate were only temporarily inactive or "frictional nonparticipants" 
(i.e,, deferred or waiting for services to begin). For example, in SWIM, 
only about 10 percent of eligibles in any month failed to participate 
without a program-approved reason. The majority of these individuals 
were inactive as a result of staff failure to assign them to an activity or to 
follow on an assignment; the remaining clients were inactive owing 
to x)peration, and sanctioning began for most of these cases. 

In Doth studies, the authors stressed the unusual circumstances for 
program administrators - in particular, the full funding of program ser- 
vices through special demonstration grants. San Diego's administrators 
also benefited from a strong labor market, a high-grant state (allowing 
many people to combine work and welfare), extensive local education 
and training services, and years of staff experience. West Virginia's 
administrators operated in a very rural state, with extremely high 



The advantage of this measure is that it includes the rangeof outcomt»s that mcvi program 
objectives or requirements. However, because it defines activities by whether they "ever" 
occurred, it is generous. The several studies in which MDRC examined the extent to which 
programparticipationwascontinuoussuggestthatthepercentwhoparticipatecontinuously 
is substantially lower than the percent who ever participate. (See, e.g., Hamilton, 1988.) ' 

^•^See Hamilton, 1988; Hamilton and Friedlander, 1989; Ball, 1984; Friedlander et al., 1986. 
Forthcoming findings from the Pennsylvania Saturation Work Pn^^ram evaluation will 
provide additional information on participation rates in a program with an ongoing 
participation requirement. 
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FIGURE 4.1 PERCENT OF AFDC AND AFDC-UP INDIVIDUALS ELIGIBLE 
FOR SWIM DURING EACH MONTH WHO PARTICIPATED 
IN PROGRAM-ARRANGED ACTIVITIES, SELF-INITIATED 
ACTIVITIES, OR EMPLOYMENT, BY TYPE OF ACTIVITY 



Participation Rate (%) 
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90 



80 



□ Employment K^JJ St'lf-lnitiated Activities Program-Arranged 

^ ■ Activities 
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SOURCE: Adapted from Hamilton. 19KK. 
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unemployment, a strong demand for subsidized labor, and a lengthy 
history of running other work programs.^^ Finally, and critically impor- 
tant in considering the relevance of these findings for state JOBS pro- 
grams, neither the SWIM nor the West Virginia program or study set any 
specific minimum on weekly hours of participation. 

If participation and sanctioning are seen as intermediate steps to- 
ward impacts, the seven studies reflect varied degrees of mandatori- 
ness.^^ The evaluators concluded, however, that San Diego's SWIM 
program and the West Virginia AFDC-UP workfare initiative probably 
achieved the maximum possible monthly participation rates for those 
programs in those locations. While it is possible that rates could be 
higher under different conditions - e.g., in a program that places more 
restrictions on deferrals or part-time employment than did SWIM, or in 
a state with lower AFDC grant levels (and thus less opportianity to 
combine work and welfare) than in California - this does not seem very 
likely. Measured participation would have been higher, however, if 
other activities had been counted, e.g., orientation, assessment, job 
placement, or ongoing informal individual job search. 

The SWIM and West Virginia studies provide information of clear 
relevance to states considering the feasibility and challenge of meeting 
the JOBS participation targets. The SWIM study is most useful, since it 
was an explicit test of a continuous participation requirement in a 
multi-component program targeted at a cross section of the AFDC 
caseload. However, the many differences in what is included in the 
numerator and denominator of the SWIM and JOBS calculations of 
participation rates make it hard to predict what the rates would have 
been had the JOBS rules been applied during the SWIM Demonstration. 



Also, the West Virginia rates are only tor men. Thi? program had much lower monthly 
participation rates (generally under 20 percent) for women on AFDC (Friedlander 
etal., 1986). 

The sixth line on Table 4.1 shows the percent of experimental deregistered from the 
program because of a request for sanction (i.e., the percent of experimentals whose 
caseworkers sent notice to the eligibility worker requesting that a sanction be imposed; 
these experimentals were effectively deregistered from the program's mandate during the 
period of the sanction). The sanction rates for experimentals were highest in San Diego I, 
SWIM, and Cook County. In evaluating the relationship of sanctioning to impacts, how- 
ever, it is important to consider the difference in sanctioning rates between experimen- 
tals and controls. In San Diego I and SWIM, few controls were sanctioned. In contrast, in 
Cook County, 7.6 perceiU of controls were sanctioned, for a net difference of 4.8 percent- 
age points. 
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Some elements of the JOBS participation calculation are clearly more 
demanding. For example, if the JOBS standard - an average of 20 hours 
per week of activity - had been applied to SWIM as it operated, mea- 
sured participation rates would have been substantially lower.'^ Also, 
JOBS expands the non-exempt population to include women with young- 
er children. Other elements of the JOBS calculation are more generous 
than what was applied in SWIM: For example, under limited cir- 
cumstances, counting in the numerator people who go to work if they 
recently participated in JOBS; hours spent in assessment and employ- 
ability plan development meetings; and school enrollment of young 
custodial mothers. The JOBS calculation is more generous, too, in ex- 
cluding from the denominator people excused from the JOBS participa- 
tion requirement for good cause, and those without access to needed 
child care. On balance, however, measured monthly participation rates 
in SWIM would have been lower under the JOBS regulations, and prob- 
ably substantially lower, principally because most SWIM activities 
would not have met the 20-hour requirement. 

Other factors in many state JOBS programs may affect participation. 
The findings in Table 4.1 were mainly for the relatively simple, usually 
fixed-sequence programs of the early and mid-1980s. It will be very 
important to see whether the more complex programs initiated prior to 
and under JOBS achieve similar rates. There has been only one study of 
a broad-coverage program that used flexible assessments to assign 
participants to a range of components; Baltimore Options involved 45 
percent of targeted persons in at least one activity. As indicated in Table 
3.1, several studies are under way on broad-coverage programs that 
contain some of the more innovative aspects of JOBS, particularly the 
greater use of education, assessment, and case management, and the 
involvement of women with younger children. While no impact or cost- 
effectiveness results are available, there are extensive implementa- 
tion and participation findings from the early start-up period of the 
implementation of California's GAIN program. 



For example, in SWIM, the two-week job search workshop consisted of three hours of 
dtissroom nctivity per day for the first week, followed by two to three hours ci supt»r\'ised 
telephone room activity per day during the second week. (Interviews with employers were 
usually held outside these hours.) Assigned hours forSWlM work experience generally 
ranged from 20 to 30 hours per week. The schedule for other SWIM components varied, 
from one or two days per month (e.g., for a follow-up job search activity) or eight half-days 
per month for Hnglish as a Second Language (ESL) classes, to 30 hours per week for some 
vocational training. 

er|c 
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Initial findings on GAIN suggest that the more enriched - and com- 
plex - JOBS programs will not necessarily achieve higher longitudinal 
participation rates than those shown in Table 4.1 . During the first 16 to 24 
months of GAIN operations in 8 of the first 10 counties to begin imple- 
mentation, and using a shorter period to measure longitudinal 
participation, GAIN rates varied substantially across counties and, on 
average, fell on the low end of rates shown in Table 4.1 (Riccio et aL, 1989), 
Thus, 34 percent of people participated in ^ome program activity within 
six months, or a shorter period than that shown in Table 4.1, although 
this rate varied from 26 to 56 percent across the eight counties. 

Figure 4.2 shows the detail behind this rate by illustrating the 
movement of 100 typical AFDC single parents who were mandatory 
registrants in GAIN during this early period: Of the 100 registrants, 71 
attended orientation and 34 of them participated in an initial component 
of the program. (Few reached a second activity in this very short, 
six-month follow-up period.) The data suggest that one of the greatest 
cha''enges in GAIN was gettin^ ^ «ople to show up for orientation.^^ Of 
thosw who did show up, almost half participated in GAIN, while more 
than 80 percent of those who did not participate were deferred or, to a 
lesser extent, deregistered. 

The bottom part of Figure 4.2 shows the reasons for nonparticipa- 
tion in GAIN components by all program registrants - including those 
who did not reach orientation - and suggests that many in fact met the 
program's mandates. Thus, two-thirds of them (or 44 of the 66 
nonparticipants) were deregistered (many because of full-time 
employment) or deferred (mostly because of part-time work, illness, or 
family emergencies). Figure 4.2 also shows that GAIN is placing 41 
percent of participants (14 out of the 34 entering an initial activity) in 
mandatory education, substantially more than have earl er initiatives. 

In Massachusetts' Employment and Training (ET) Choices program, 
participation data are available, but were not collected in a form that is 
directly comparable to the participation measures in Table 4.1 . Of all the 
adults who were on AFDC in Massachusetts during fiscal year 1987 (July 
1, 1986, through June 30, 1987) - i.e., not just people who were normally 



This suggwts that ma.idatory programs, even tht>se offering many more opportunities 
than were typical in the I98(hi programs, will still nei^d to adopt aggressive outreach and 
follow-up prtKedures in order to mr.tch the Table 4.1 participation rates. 
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FIGURE 4.2 PARTICIPATION PATTERNS AND REASONS FOR NONPARTICIPATION FOR 100 T\ PICAL MANDATORY 
SINGLE-PARENT REGISTRANTS WITHIN SIX MONTHS OF GAIN REGISTRATION 




29 Did Not Attend iin 
Orientation or Appraisal: 

• lX»registfred 11 

• Deferred 3 

• No Explanation'^ 15 



Orientation 
and Appraisal 
71 



Initial Component 
34 

Basic Education 
Job Search 
Self-Initiated 

Education or 

Training 10 



37 Did Not Participate in 
Any Compt)nent: 

• lX»registered 7 

• Deferred 23 

• Lack ot FoUovv-Up 7 




31 Did Not Reach 
Assessment: 

• IX'registered 

• Deferred 

• Dropped Out 

• Still Enrolled in 

Initial Component 



Post-Assessment 
Components 
2 

Work Experience 1 
Education or 
Training 1 



1 Did Not Reach 
Second Component: 

• De registered 

• Deferr<?d 

• Dropped Out 

• Still in Assessment 



SOURCE: Adapttxl from Riccio et al., 1989. 

NOTES: The 1(X) typical registrants represent the experiences of a 966-person random sample of single-parent (AFDC) GAlN-mandatory registrants from 
seven study counties. ^ " 

Findings for heads of two-parent households (AFIX-Ul' registrants) were similar to those presented above for single parents. 

^ C;AIN case files included no information explaining why these registrants did not attend orientation. 

1 he listed reasons are possible explanations for nonparticipation. Data showing the actual importance of each reaiion were not collected for this study. 
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required to register for WIN -33 percent participated in training or an- 
other substantive activity other than orientation and assessment during 
the fisca 1 yea r. An a dd itional 1 7 percent of those on welfa re in FY 1 987 had 
previously participated in a substantive ET activity, but were not active 
in FY 1987. Among those who participated in substantive ET activities, 44 
percent became employed. Using a very broad definition of participation, 
a total of 67 percent of those on the AFDC rolls in FY 1987 had ever 
participated in ET orientation, assessment, or a substantive activity 
(Nightingale et al, 1989). 

Findings from the evaluations of GAIN, New Jersey REACH, Hor- 
ida Project Independence, the Pennsylvania Saturation Work Program 
(PSWP), and Ohio Transitions to Independence should provide addi- 
tional information on participation in more compkx JOBS programs. 

Findings on Impacts for AFDCs 

This section discusses whether the participation levels, services, and 
mandates in the seven programs produced impacts for AFDC eligibles.^^ 
Overall, the studies provide grounds both for optimism and caution. 
They show that these programs were generally successful in getting more 
people to work and in assuring that a greater share of their total income 
came from their own earnings, rather than public transfers. With two 
exceptions, these low- to moderate-cost programs led to 10 to 30 percent 
increases in employment rates and earnings (calculated as averages 
across all memi » s of the targeted population in the caseload).^^ They 
also usually reduced welfare costs, although the welfare reductions were 
smaller and less consistent than the earnings gains. r.\ ^> ?neral, this was 
true for both the very low-cost job search/ work experience programs in 
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18 

No final results a re currently available from the other studies of broad -co verageprogranns 
listed in Chapter 3, except for the I^uisville studies. 

19 

As indicated in Chapter 2; because random c»ssignment occurred at the income mainte- 
nance or welfare employment program office, thei>e studies included in the experimental 
groups all people targeted by the program, and not only those who actually participated. In 
four of the seven studies, random assignment took place at the income maintenance office, 
and the estimated impacts are averages for the full targeted caseload. In SWIM, Arkansas, 
and West Virginia, only those in the mandatory population whoshowed upatthe program 
were randomly assigned. However, since the program office and income maintenance of- 
fice were ccvlocated in bothArkansas and West Virginia, the difference between thenumber 
of people eligible and number eligible but not ' egistered was probably greatest in SWIM. 
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Arkansas and Virginia and the more enriched, multi-component pro- 
grams in BalHmore and San Diego (SWIM). These impacts varied substan- 
tially for different subgroups of the caseload. The study of San Diego's 
SWIM also showed employment gains and welfa re savings for AFDC-UP 
eligibles. When one looks behind the averages, the findings further 
suggest that the impacts probably resulted from substantial changes for 
some people and minimal changes for others. Finally, the combination of 
earnings increases and welfare reductions suggests tha'. total income 
increased, but usually not by enough to move families out of poverty. 

Table 4.2 summarizes the results for AFDC eligibles in the seven 
studies, showing data for three years following random assignment in 
Arkansas, Baltimore, and Virginia, and one or two years in the other 
locations.^" (See Appendix Tables B.l through B.7 for more detail on the 
quarterly trends behind these annual data.) The firet column shows the 
outcomes for experimentals; the second, for controls, some of whom par- 
ticipated in alternative education or training programs;^' the third col- 
umn, the difference or net impact; and the final column, the percentage 
increase or decrease over the outcome for the control group. Several 
features of the table are important to interpreting the results. First, the 
data shown in the table are for all people in the experimental or control 
groups of the research sample. Thus, the earnings numbers average zero 
values for people who did not work during the year with positive 
amounts for people who did; the AFDC payments average the zero 
values for people who did not receive welfare during the year with the 



Appendix Bcimtains impncts for up to 18 months for the Cook County (Illinois), San 
SnrM VVesl^ Virginia studies. Those more det.iiled findings are consistent with the 
short-term impacts summarized ,n Table 4.2. Another document (Maxfield, 1990) also 
presentstheimpactsonannuaUMniingsforthestudiescontainedinTable4.2,butKivesdif- 

Jmn^^Ml 'k'^V' ^'^T'^'' '"'^ '^'"'"^■''^ ^i'^-** the first published 

impact data which cover only 2 to 4 quarters of follow-up. Table 4.2 uses later results 
which include about three years of follow-up. For some of the other studies, Mnxfield's 
annual earnings impacts differ because they appear to be calculated by averaging impacts 
over different time peruKls, ranging from quarters 2 to 6 in San Diego I to quarfers 6 to9 
in Baltimoreand quarters 2 to 11 in Maine. 

^I^Whiletheextentofamtrolserviceswasnot measured inallseven(,fthestudies,t^ 
able findings suggt;st httle receipt of program services but some self-initiated education 
and training activities. For example, in San Diego SWIM, few controls received job search 

ApJ^'frrf'^V'T*-'' 'l"*''''^"' A^"DC« .ind almost 20 percent of 

?»h^n^ / receivtui some education or training. Asa rc^uh, as noted in Chapter 
2, tht nt impacts in Table 4.2 are conservative estimates of the gains that follow receipt of 
the services provided by the welfare-to-work programs. ^ 
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TABLE 4.2 IMPACTS OF SEVEN WELFARE-TO-WORK PROGRAMS 
ON AFDC ELIGIBLES 



LiKation, CXitcome, 
and Follow-Up Period 




Experimental 
Vjroup Mean 


Control 


Difference 


Percentage 
Change 


Arkansas 

Average Earnings 


Yearl 
Year 2 
Year 3 


$ 674 
1,180 
1,422 


$ 507 
957 
1,085 


$167** 
337** 


337o 

£.0 

31 


Employed at End of 


Yearl 
Year 2 
Year 3 


20.4% 

23.9 

24.5 


16.7% 
18.3 


3.7* 
6.2*** 


22% 

IS 

34 


Average AFDC Payments 


Yearl 
Year 2 
Year 3 


$998 
793 
742 


$1,143 
982 
910 


-$145*** 
- 190*** 
-168*** 


-13% 

-19 

-18 


On Welfare at End of 


Year 1 
Year 2 
Year 3 


51.0% 

38.1 

32.8 


59.1% 

46.U 

40.1 


-8.1*** 
-7.9*** 
-7,3"** 


-14% 

-17 

-18 



Baltimore 

Average Earnings 



Employed at End of 



Year 1 


$1,612 


$1,472 


$140 


10% 


Year 2 


2,787 


2,386 


401*** 


17 


Year 3 


3,499 


2,989 


511*"* 


17 


Year 1 


34.7% 


31.2% 


3.5** 


11% 


Year 2 


39.5 


37.1 


2.4 


6 


Year 3 


40.7 


40.3 


0.4 


1 



Average AFDC Payments 


Year 1 


$2,520 


$2,517 


$2 


0% 


Year 2 


2,058 


2,092 


-34 


-2 




Year 3 


1,783 


1,815 


-31 


-2 


On Welfare at End of 


Year 1 


72.0% 


73.3% 


-1.4 


-2% 
-1 


Year 2 


58.7 


590 


-0.3 




Year 3 


48.2 


48.4 


-0.2 


0 


Cook County 






$1,217 


$10 




Average Earnings 


Year 1 


$1,227 


l^/c 


Employed at End of 


Year 1 


22.6% 


21.4% 


1.3 


67r 
-1% 


Average AFDC Payments 


Year 1 


$3,105 


$3,146 


-$40 


On Welfare at End of 


Year 1 


78.9'/r 


80.8% 


-1.9** 


-2% 


San Diego I 












(Applicants Only) 










23% 


Average Earnings 


Year 1 


$2,379 


$1,937 


$443*** 


Employed at End of 


Year 1 


42.4% 


36 9% 


5.5*** 


15% 


Average AFDC Payments 


Year 1 


$2,524 


$2,750 


-$226*** 


-8% 


On Welfare at End of 


Year 1 


45.8% 


47.9% 


-2.0 


•4% 



kontmied) 
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TABLE 4.2 (continued) 



Location, Outcome, 
and Follow-Up Period 




Experimental 
Croup Mean 


Control 
Group Mean 


Difference 


Percentage 
Change 


San Diego SWIM 

Average Earnings 


Year 1 
Year 2 


$2,029 
2,903 


$1,677 
2,246 


$352*** 
658*** 


21% 
29 


Employed at End of 


Year 1 
Year 2 


34.7% 
34.7 


26.9% 
29.3 


7.7*** 
5.4*** 


29% 
18 


Average AFDC Payments 


Year 1 
Year 2 


$4,424 
3,408 


$4,830 
3,961 


-$407*** 
- 553*** 


-8% 
-14 


On Welfare at Hnd of 


Year 1 
Year 2 


r> 1 .A 


72.4% 
5H.7 


-6.4*** 
-7.4*** 


-9% 
-13 


Virginia 
Average Earnings 


Year 1 
Year 2 
Year 3^* 


$1,352 
2,624 


$1,282 
1,988 
2,356 


$69 

280** 

268* 


5% 
14 
11 


Tniployed at End of 


Year 1 

YtMr ? 
1 t-tii ^ 

Year 3^ 


34.7% 

Hi 1 

38.7 


31.0% 

33.3 

34.1 


3.8** 

6.0*** 

4.6*** 


12% 

18 

13 


Average AFLXL' Payments 


Year 1 
Year 2 
Year 3'^ 


$1,961 
1,480 
1,184 


$2,029 
1,516 
135 


-$ 69 
- .In 
-111** 


-3% 

-2 

-9 


On Welfare at End of 


Year 1 
Year 2 
Year 3^' 


S9.8'/r 

44.0 
.36.6 


59.4% 

44.9 

39.3 


0.4 
-0.9 


-2 
-7 


West Virginia 

Average Earnings 
Employed at End of 
Average AMX' Payments 
On Welfare at End of 


Year 1 
Year 1 
Year 1 
Year 1 


12.0% 
$1,692 
70.9?( 


$435 
13.1% 
$1,692 


$16 
-1.0 
$0 
-1.5 


4% 
-8% 

0% 
-2% 



r,.l 1 . "■".i.inacT.iira i,„iam..|i, I9««; FriullandiT, 1987; ETicdl.iiidcr f il 1W7 

Goldman hncdlandcr, and Long, 1,86; „„„„|„,„ ,,„d F,irf|„„d,r lim S 'd;. li 

k\mtiinH'ii> 
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TABLE 4,2 (continued) 



"Employed" or "on welfare" at the end of the year is defined as receiving earnings or welfare 
payments at some point during the last quarter of the year. 
Earnings and AFIXT payments are not adjusted for inflation. 

^Annual earnings and AFDC payments impacts are based on two and three quarters of follow-up, 
respectively. 

^Percent employed and on welfare at the end of 2 1 /2 and 2 3/4 years, respectively. 
"^Denotes statistical significance at the 10 percent level; **at the 5 percent level; and ***at the 1 percent 
level. 
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positive amounts for people receiving benefits. This means that the 
earnings and welfare payments of the people who actually worked or 
received benefits can be substantially higher than the values shown in 
columns one and two. For example, Table 4.2 shows that, in the second 
year after random assignment to the San Diego SWIM study, the average 
experimental earned $2,903; however, since only 49.4 percent of 
experimentals worked at some point during that year (not shown in the 
table), the average employed experimental earned about twice that amount. 
Second, the striking variation across the studies in the outcomes for 
members of the control groups points to the substantial differences in 
characteristics of the welfare populations and labor markets in these 
locations. Finally, in Table 4.2, and throughout this chapter, earnings 
and welfare payments are reported in nominal dollars for the period of 
the study. 

Five of the seven programs had statistically significant impacts on 
employment rates at the end of the first year after program enrollment. 
These gains ranged from 3.5 percentage points in Baltimore to 7.7 
percentage points in the SWIM program. For example, in San Diego I, 
36.9 percent of the controls were employed at the end of the first year of 
follow-up compared to 42.4 percent of the experimentals, for a gain of 5.5 
percentage points. Further, during the full year, experimentals (includ- 
ing both those who were working and those who were not) earned an 
average of $443, or 23 percent, more than the $1,937 earned by controls. 
In the other four programs, first-year earnings by experimentals were 5 
to 33 percent above those for controls. 

The longer-term (two- or three-year) follow-up available for four 
programs indicates that these short-term earnings impacts persisted or 
grew over time, possibly reaching a peak around the end of the second 
or beginning of the third year. Despite increases in the employment and 
earnings of controls over the three years, experimentals continued to do 
better than controls. (Figures 4.3 and 4.4 show, for Arkansas and Balti- 
more, the quarterly trends over the full three years in the sample's 
average earnings and in the percent of the sample that was working.) In 
Arkansas, by the end of year 3, the experimentals' employment rate was 
6.2 percentage points above tha^ for controls and they earned, over the 
year, an average of $337, or 31 percent, more than controls. In Baltimore, 
while there was no significant long-term difference in employment 
rates, experimentals in year 3 earned $511, or 17 percent, more than 
controls. Overall, earnings per eligible person in the caseload averaged 
$270 to $650 above the control rate in the final year of the study. 



FIGURE 4^ TRENDS IN AVERAGE QUARTERLY EARNINGS 
IN ARKANSAS AND BALTIMORE 

"" Baltimore Experimcntals — — — — Arkansas Experimentals 

Baltimore Controls Arkansas Controls 
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FIGURE 4.4 TRENDS IN AVERAGE QUARTERLY EMPLOYMENT 
RATES IN ARKANSAS AND BALTIMORE 



Baltimore Experimentals 
Baltimore Controls 



Arkansas Experimentals 
----- Arkansas Controls 



Quarterly Employment Rate (%) 
45 




20 



15 



10 



0 -L ; - ; : -1 ■ - ; ; ■ 

2 34 56789 
Quarter of Follow-Up 



10 11 12 



SOURCES: Tables B.l and B.2, 
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A more detailed examination of the earnings data in these studies 
suggests several hirther findings. First, in the programs that provided 
primarily job search assistance (e.g., Arkansas and Virginia), the earnings 
gains resulted principally from increases in the number of people who got 
jobs, not from higher earnings (wages or hours) for those working,^ This 
was also the case in SWIM, where the relatively large impact on earnings 
resulted mostly from an increase in the number of people working 
(Hamilton and Friedlander, 1989). This was less true in Baltimore (a 
program providing some education and training), where some exper- 
imentals either were paid higher wages or worked longer weekly hours 
as a result of the program (Friedlander, 1987),^ Second, in the SWIM and 
Baltimore programs, there was a statistically significant increase in the 
percent of people with somewhat higher earnings in the longer term: In 
Baltimore, there was a 3.8 percentage point gain in the share of people 
earning more than $6,000 a year; in SWIM, a 4.6 percentage point in- 
crease in the share of applicants and recipients earning $5,000 or more a 
year and a 3.2 percentage point gain in the share of recipients earning 
$10,000 or more a year. However, these increases resulted from two very 
different patterns of impacts on the earnings distribution of people who 
got jobs: SWIM increased the number of people with relatively low as well 
as relatively higher earnings and did not change the overall earnings 
distribution, whereas the employment increase in Baltimore was con- 
centrated in the higher earnings category (Friedlander, 1987; Hamilton 
and Friedlander, 1989). Third, the Baltimore results suggest that the 
impacts of adding education and training in a mixed strategy may not 
show up quickly. Thus, while earnings impacts were a statistically 
insignificant $140 in the first year, they increased sharply to $401 in the 
second year and $511 in the third (see Table 4.2). 



The two Louisvillo studies found a similar pattern of employment gains. There were 
consistent and statistically significant increases in quarterly employment rates and earn- 
ings and little evidence of any improvement in job quality. The studies found that the two 
programs had differing effects on welfare payments. The Louisville Individual Job St arch 
Experiment found a statistically significant reduction in the percentage of people receiving 
welfare during most of the 11 quarters of follow-up and reduced AFDC payments in most 
quarters. The Louisville Group lob Search Experiment found no significant reductions in 
the percentage on welfare or on AFDC payments (see Wolfhagen, 1983). 

Since Unemployment Insurance earnings records were the source of folU)W-up data, it is 
not possible to determine whether <?amings gains resulted from changes in work hours 
or wages. 
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ImpactsonAFIXreceiptweresmallerandlessconsistentthanthose 
on employment and earnings. As Table 4.2 shows, only two of the five 
programs with employment effects - Arkansas and SWIM - resulted in 
stahstically significant reductions ii. .ate of receipt of AFDC benefits in 

thefirstandsubsequentyearsoffollow-up.In both cases, welfare receipt 
among the targeted WIN-mandatories was reduced 6 o 8 percentage 

pomtsatthe end ofeachyearofthestudy,leadingto welfare savingsof 
UtolSpercentmthelastyearoffoUow-up.Whileitisnotsurprisingthat 
InT T'"'iL"'T? ''^ '''' ^^'^^"^^^ with very 

iolTn iTn?" '"^P^''^'^' ''''' ^"^'^ reduc- 

tions in AFDC receipt despite the relatively high grants in California.^* 
The longer-term results for the four programs with two- to three-year 

ollow-up show that impacts on average annual welfare payments 
ranged from close to zero in Baltimore to $553, or a 14 percent saving in 

Arkansas and Baltimore, the quarterly trends over three years in a;er- 

.^safS^L" 

Table 4.2 also shows a surprising lack of relationship between the 
size of the earnings and welfare impacts. For example on average 
Baltimore and SWIM had the highest earnings gains, but ;ery dSm 



eatings of female AFDC^ rt pan sTv S^^^ 

second, and $340 in tht- th.rd Jth llSisSv f P*"*''P^"8ram year, $520 in the 
ment. Tl.e study also condud^dlatC aT^^^ IT^^r^n'^t"" V?:^'"^ 
reduction in welfare payments (See Burtlp« igxu^'^ \ ''"""'P'in'«--d by any 

and methodology in thisTtudy ) ' ' ' '"'"'"'^y «"dings 

unm^^SXrs^ 

almost$3(X)pc.ryear.(Tlei!n;S:'^^^^^^ 

are less certain, but wer.. .H;tim.,„^ u.r.,:u.;- ' ."^"''"i'''y''"r''''ed ni the program 




oblain..i employme, which alK^^^^^^^ '"^ ''^'^''"^ who 

possibility that ^^rn ngs g ?s ci^^^^u^^^^^^^ ^^^"'f"^'' '^"d to the 

Without tl. program, f^^f B ^n? u5 '''' ''^^ ^""^ 
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FIGURE 4.5 TRENDS IN AVERAGE QUARTERLY AFDC PAYMENTS 
IN ARKANSAS AND BALTIMORE 

t«»M«««««««« Baltimore Experimenlals • • — Arkansas Experimentals 
Baltimore Controls Arkansas Controls 

Quarterly AFDC Payments ($) 

700- - 

i 

I 

600 ^ 

\ ^^^^ 
500 j ''^^ 

400 ! 

300 ^ 



200 : ^ * -i • — • -ii- a, 

100 * 
J 

0 — ' ^ ^ 1 ........ : .... : 1 ._. .... 

1 2 3 4 5 6 7 8 9 10 11 12 
Quarter of Follow-Up 

SOURCKS: Tables B.l and B.2. 
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FIGURE 4.6 TRENDS IN AVERAGE QUARTERLY AFDC RECEIPT 
IN ARKANSAS AND BALTIMORE 

Baltimore Experimentals Arkansas Experimentals 
Baltimore Controls Arkansas Controls 
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welfare impacts. Friedlander (1987) offered several reasons why the 
Baltimore earnings gains were not accompanied by welfare savings. 
First, he confirmed that welfare grants were reduced as earnings in- 
creased; but that the reductions were limited.^^ Second, he noted that 
some of the people who got jobs through the program would probably 
have moved off welfare anyway, although to jobs in which they earned 
less. Finally, he suggested that there may have been welfare savings for 
those who found employment that were offset by increases in the time 
on welfare for others (e.g., for people in lengthy program activities). 

A comparison of the earnings and welfare impacts in Table 4.2 
suggests that the programs differed in their impact on average total 
income from the two sources. In some locations (e.g., Arkansas), the pro- 
gram caused people to rely more on employment and less on welfare, but 
did not result in much increase in average combined income from the 
two sources. In others, there was a clear increase in average total income 
and in the number of people in higher income brackets: For example, in 
Baltimore there was a 4.5 percentage point increase in the share of people 
with combined incomes of more than $6,000 a year (Friedlander, 1987). 

These studies also provide useful information on how a welfare-to- 
work program can affect the rate at which people move in and out of four 
different combinations of work and welfare: not employed and on wel- 
fare, employed and on welfare, employed and not on welfare, and not 
employed and not on welfare. Appendix Table B.8 shows that in SWIM 
fewer experimental^ than controls remained jobless and on welfare, that 
over time the percent combining work and welfare at first grew and then 
declined, and that by the end of the study more people were working and 
off welfare completely. The last panel in Appendix Table B.8 also shows 
that a substantial number (about a quarter) of women in the sample were 
both off AFDC and not working by the end of the two-year follow-up. 
Moreover, the SWIM program significantly increased the size of this 
group. Similar results were found in other studies (e.g., in Arkansas).^'^ 



A study using case file data to examine the rate at which welfare grants were reduced as 
people in the samples in Baltimore, San Diego, Virginia, and West Virginia went to work 
indicated that the reductions were less than specified in the regulations. On average, the 
study showed that, among people in Baltimore simultaneously on welfare and working, an 
additional dollar of earnings reduced the monthly AFDC grant by 44 cents, the lowest 
reduction rate for the four areas studied. (See Goldman et al., 1985a.) 

^' These studies (because of their reliance on administrative records) could not examine the 
alternative sources of income for this group or whether there were any changes in 
household structure, suggesting the importance of further research in this area. 
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The findings from the two areas without statistically significant 
employment and earnings impacts constitute important exceptions. In 
West Virginia, a rural labor market with very high unemployment 
strongly conditioned program planners' expectations. They had little 
hope that the poor local labor market could provide jobs, and as a result 
did not incorporate a job search component. Thus, while the program 
reinforced community preferences for work, kept job skills from 
deteriorating, and provided useful public services, it did not translate 
these gains into unsubsidized employment. The program in Cook Coun- 
ty, Illinois, also resulted in no significant increases in employment and 
earnings, although there were small welfare savings. Here, the explana- 
tion may lie in the program design. The Cook County program, one of the 
two least expensive of those studied (with net costs averaging less than 
$200 per experimental), mainly monitored people and sanctioned those 
who did not participate, providing little direct assistance even in its job 
search component. These exceptions provide useful reminders of the 
influenceoflabormarketconditionsand,possibly,ofthe need to provide 
some real assistance to get employment results (if not welfare savings). 

Taken together, the employment and welfare impacts for AFDCs 
point to both the potential and limits of these programs. The earnings 
gains take on greater significance because they were averages that 
included all f -rsons eligible for the program, not just the approximately 
50 perrent who actually received services, the smaller percent who 
worked during any three-month perit)d, or the even smaller percent who 
actually benefited from these programs through new jobs or higher earn- 
ings. For this last group, the actual gains were probably much larger. 

This seeming contradiction is because Table 4.2, as in most such 
studies, reports average impacts, and such averages can conceal a very 
mixed pattern of effects. As noted by Friedlander and Gueron in a 
discussion of the same results: 

We . . . deal with impacts that are averages across a large number 
of individuals. But such averages probably give a misleading 
impression of how these programs affect individual behavior. 
An impact of $300 in average annual earnings, for example, may 
seem to suggest that a program raised the earnings of most sam- 
ple members by about $300. In fact, impacts on employment 
rates . . . suggest that it is more likely that only a small proportion 
of program enrollees actually change their employment behav- 
ior. For example, an earnings increase of $300 per experimental 
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in a job search program is probably concentrated among 5 to 10 
percent of experimentals.^® The annual earnings gains for many 
of these individuals may be several thousand dollars, especially 
for those who would not have worked without the program but 
who secure stable employment with its assistance. A similar 
situation exists for welfare impacts: Reductions of several 
thousand dollars can occur for the small number of long-term 
recipients who are induced to leave the rolls, with only minimal 
effects for the other program enrollees.^^ 

While the results thus indicate that some people may have substan- 
tial earnings gains as a result of these programs, the overall findings 
(where many also remain unaffected)clearly also suggestcaution. Alone, 
these initiatives do not offer an immediate cure for poverty or welfare 
dependence. Even with these programs, many people continue on wel- 
fare, and those who move off the rolls often remain poor. 

Findings on AFDC Subgroup Impacts 

A critical decision in the design of state JOBS initiatives will be 
whether programs should try to reach the entire mandatory caseload or 
target speci Ic subgroups, e.g., potential long-term recipients. The 
programs summarized here shed light on this issue because they were 
not narrowly selective but, rather, tried to reach all welfare applicants 
and recipients meeting broad eligibility criteria. 

An analysis of five programs - San Diego I, Baltimore, Virginia, 
Arkansas, and Cook County (but not San Diego SWIM) - addressed the 
targeting problem by examining program impacts for different AFDC 
subgroups within the overall samples (Friedlander, 1988b). The study 
investigated the possible connection between dependence and impact. 
The findings raised serious concerns about the "common sense" strategy 
of giving priority attention to the most job-ready candidates. They 
also suggested that the conclusion for targeting would depend on 
whether a program's major goal was reducing welfare costs or raising 
people's earnings. 

Table 4.3, from tho Friedlander study, shows the five programs' 
impacts on quarterly earnings and AFDC payments for different welfare 
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Maximum quarterly impacts on employment rates fall within this range. 
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TABLE 43 PROGRAM IMPACTS ON QUARTERLY EARNINGS AND 
AFDC PAYMENTS FOR MAJOR SUBGROUPS OF AFDC 
APPLICANTS AND RE'TIPIENTS 



Subgroup and Outcome San Diego I Baltimore Virginia Arkansas Cook County* 

First Tier 

Applicants with No 
Prior AFDC: 
Earnings 
AFDC Payments 



$37 
-5 



$121 
-9 



-$13 
-28 



$26 
-31 



$^- 



Second Tier 

Applicant Returnees: 
Earnings 
AFDC Payments 

Applicant Returnees 
with Less than $3,000 
Prior Earnings: 

Earnings 

AFDC Payments 



$158»* 
-47 



15r* 
-63* 



$188*** 
-15 



253»»* 
-19 



$114* 
-16 



20 
-29 



$211*** 
-19 



202* 
-22 



$- 



Third Tier 

All Recipients: 
Earnings 
AFDC Payments 

Recipients with More 
than 2 Years on 
AFDC: 

Earnings 

AFDC Payments 

Recipients with No 
Prior Earnings: 

Earnings 

AFDC Payments 

Recipients with No 
Prior Earnings and 
More than 2 Years 
on AFDC: 

Earnings 

AFDC Payments 



$ - 



$37 
5 



0 
19 



104* 
1 



!|^9» 
-24 



110** 
-48** 



70 
-26 



88 
-1 



94* 
-48** 



$19 
-60*' 



14 



29 

-63*** 



28 
'48» 



$46** 
-13 



12 

-6 



Full Sample 

Quarterly Impact: 
Earnings 
AFDC Payments 

Average for Control 
Group: 

Earnings 

AFDC Payments 



$118*** 
-33 



773 
469 



$96»»* 

-5 



634 
501 



$72* 
-23* 



541 
345 



$70** 
-40*** 



257 
232 



$19 
-13 



451 

646 



(contimicd) 
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TABLE 4.3 (continued) 



SOURCE: Data from Friedlander; 1988b. 

NOTES: Tiers are mutually exclusive; subgroups within tiers overlap. All values are quarterly 
averages for the fourth through the last quarter of follow-up. Estimates include zero values for sample 
members not employed and for sample members not receiving welfare. 

A two-tailed t-test was applied to differences between experimental and control groups. Statistical 
significance levels are indicated as: * = 10 percent; ** = 5 percent; and = 1 percent. 

^The definitions of "applicant" and "recipient" for Cook County are not strictly comparable to those 
of the other programs. See the text of Friedlander, 1988b, for discussion. 
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groupsJntermsofearnings gains, themostemployablepeople-women 
who were hrst-time welfare applicants, in the "first tie- the tabTe 

.Tnw H !, K °' "° ''"^'"8^ •'"P^'^*^- While this group 

showed h^h program outcomes (e.g., as measured by employment 

erouo Thar P^°P''- -ntrol 
group. That ,s even without special assistance, many of these women 

stayed on welfare only for relatively brief periods. In contrast, more 
dependent groups - e.g., people applying for welfare who had previ- 
eaTlTrr P"^"^^^^^f '"^'"ding those who had limited prior 
ea^^nngs,thesecondt,erofTable4.3-benefited more consistently from 
these programs, even though the programs (with the excepHon of 
Baltimore) offered only limited assistance and almost no intensive 

Safte?"' '"'"^ — remained on 

welfa e after receivmg services (i.e., their measured "outcomes" were 

bwer), their performance relative to similar people in the control group 
was more impressive. However, the study also identified a third Tier o^ 
oirrent recipients - including long-term welfare recipients and those 
with no recent employment - who did not show as consistent or large 
earnings impacts. » 

Shifting the focus to welfare savings, the results suggest a different 
d^tnbuhon of .mpacts. The finding lor the most emplo^Ke (i.e thoi 
m the ftrst her) is the same: small and usually below-average w lfa^ 
unpac s^ However, in contrast to the earnings gains, the largest and 
most consistent welfare savings usually occurred for tL most 
disadvantaged groups. 

This study thus provided strong evidence against "creamine" - i e 

ra"es'" buTl"' r"'/'"""*"'' "igh placement' 

rates - but did not confirm narrow targeHng of these low- to moderate- 

costprogramsonthemostdisadvantaged.'"ltalsosuggestedthatBroups 
whose level of disadvantage was greater than som'e' thresho S 
r^ui re more than low-cost services in order to realize an earnings fm- 

pactJnteresingly,thesubsequentstudyoftheSWlMprogram(complet- 
ed after the f,ve-p™gram analysis), which provided a somewhat moTe 
mtensivetreah nentthan^of the five programs except Baltimore dW 

Hmups withCgM Imparts K ^ >^ pragr.™,, U.^Md ,o Ihe 
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show relatively large impacts on the more dependent half of the AFDC 
sample in the third tier. As shown in Table 4.4, people in the SWIM 
study who were already AFIX recipients ut the time of random assign- 
ment showed surprisingly large impacts. At the end of the second year, 
the employment rate for recipients in the SWIM experimental group 
exceeded that for controls by 8 percentage points, and recipients were 
also 8 percentage points less likely to be on welfare. During that year, 
earnings were $889, or 50 percent, above those of controls, and welfare 
payments were $608, or 13 percent less. In contrast to other studies,^^ 
SWIM had less robust employment impacts for AFDC applicants. 

Friedlander (1988b) also found that a small number of simple, 
objective characteristics collected at the point of program enrollment 
could distinguish groups with large differences in welfare receipt. For 
adults, prior earnings and welfare history were the most important 
characteristics; high school diploma status also contributed.^^ The study 
could not demoniitrate which one of these three characteristics would be 
most closely linked with program impact. Thus, for example, the study 
could not conclude whether weak prior earnings would always be a 
better or worse targeting characteristic than long welfare history or the 
absence of a high school diploma. A variety of other variables - such as 
age, number of children, and ethnicity - increased the complexity of the 
model of long-term welfare receipt but did not dramatically improve 
predictive power. Appendix Table B.9 shows impact results for various 
subgroup characteristics. 

The findings on the effectiveness of work programs for different 
subgroups of welfare recipients have implications for performance 
standards, i.e., for the extent to which the use of certain standards would 
encourage programs to maximize long-term earnings gains and reduc- 
tions in welfare dependence. Specifically, the lack of correlation be- 
tween simple outcomes and impacts confirms that unweighted place- 
ment idtcc or rase closure rates do not provide valid performance 
standards for this population (Friedlander, 1988b). 

Table 4.4 shows this distinction for applicants and recipients in the 
SWIM program. While annual earnings (outcomes) in the second year 
were higher for experimentals who were new applicants than for those 
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TABLE 4.4 IMPACTS OF THE SAN DIEGO SWIM PROGRAM ON AFDC APPLICANTS AND RECIPIENTS 







AFDC Applicants 




APX: Recipients 


Outcome and 
Follow-Up Period 


Experimental 
Group Mean 


Control 
Group Mean 


Difference 


Percentage 
Changs 


Experimental 
Group Mean 


Control 
Group Meoji 


Difference 


Percentage 
Change 


Average Earnings 
Yearl 
Year 2 


$2,607 
3,298 


$2,238 
3,011 


$369 
287 


16% 
10 


$1,652 
2,651 


$U19 
1,762 


$^.33»* 
8B9**» 


25% 
50 


Employed at End of 
Yearl 
Year 2 


38.37o 
34.2 


33.2% 
33.8 


5.r* 

0.4 


15% 
1 


32.3% 
34.9 


22.9% 
26.5 


9.4*** 
8.4*** 


41% 
32 


Average AFDC Payments 
Year 1 
Year 2 


$3,381 
2,354 


^ 724 
2,821 


-467*** 


-9% 
-17 


4,086 


>/S94 


-608*** 


-o /o 

-13 


On Welfare at End of 
Year 1 
Year 2 


51.7% 
■37.4 


58.0% 
43.4 


-6.4** 
-6.0** 


-11% 
-14 


75.2% 
60.3 


81.8% 
68.5 


-6.5*** 
-8.1*** 


-8% 
-12 



SOURCE: Data from Hamilton and Friedlander, 1989. 

NOTES: The earnings and AFDC payments data include zero values for sample members not employed and for sample members not receiving welfare. 
Estimates are regression-adjusted using ordinary least si^uares, controlling for pre-random assignment characteristics of sample members. There may b<» 
some discrepancies in experimental-control differences because of rounding. Year \ l>egins with the quarter following the quarter of random assignment, 
and all outcomes were calculated for calendar quarters. 

"Employed " or "on welfare" at the end of the year is defined as receiving earnings or welfare payments at some point during the last quarter of the year. 
5g Earnings and AFDC payments are not adjusted for inflation. 

"* Denotes statistical significance at the 5 percent level; and *** at the 1 percent level. 
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who were already receiving welfare (on average, a more disadvantaged 
group), the program's net impacts were greater for recipients. Similarly, 
while AFDC receipt and average payments were substantially lower for 
experimentals who were new applicants, this did not reflect greater net 
impacts, but rather differences in characteristics that also had a powerful 
effect on the behavior of members of the applicant control group. 

Findings on Impacts for AFDOUPs 

As indicated in Chapter 2, FSA requires all states to implement a 
public assistance program for two-parent families: the AFDC-UP 
(Unemployment Parent) program. It also calls on states to involve (with 
eventual very high participation rates) at least one parent in these 
families in JOBS activities that emphasize work. (For young pa rents who 
have not completed high school or its equivalent, education may be 
substituted.) In contrast to the strong record from numerous studies of 
pre-JOBS programs for single parents on AFEX: (primarily women), 
there are only two comparably reliable studies - both from San Diego - 
for fathers, usually the adult involved in AFDC-UP work programs. 

Table 4.5 presents the summary impact data from the San Diego I and 
SWIM studies. (Of the evaluations discussed in the preceding sections, 
three did not include AFDC-UPs, the Baltimore sample was too small to 
produce reliable findings,and the West Virginia studyproduced uncertain 
results.^^) The first San Diego program, which served only applicants, 
resulted in no sustained employment and earnings impacts, but it did 
produce welfare savings that were somewhat larger than those for the 
AFDC women who were applicants in the same program.^ Compared to 
the AFDCs, more of the mostly male experimentals were working and 
had higher earnings, but more of the controls were also working. A 
surprisingly high percent of the men were still receiving AFDC-UP ben- 
efits at the end of follow-up and, because of their larger case size, they 
had larger average grants than those of the AFDC women. The SWIM 
study, which included aj^plicants and recipients, showed a more robust 
and consistent pattern of impacts for AFDC-UP eligibles than did the 

The West Virginia AFDC-UP study compared results across counties that implemented 
a saturation or more limited program. Because of differences in labor markets and the 
characteristics of welfare recipients, as well as data coverage, the evaluation did not ieach 
a clear conclusion on the impact of saturation. (See Friedlander et aL, 1986.) 

^ The study suggests that the explanation may be, in part, the different eligibility and 

sanctioningrules for AFDC-UPsthatapplieddurinj5thestudyperiod(Goldman, Friedlander, 
and ong, 1986). 
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TABLE 4.5 IMPACTS OF TWO WELFARE-TO-WORK PROGRAMS 
ON AFDC-UP ELIGIBIES 



Location, Outcome, 
and Follow-Up Period 


Experimental 
Group Mean 


Control 
Group Mean 


Difference 


Percentage 
Changt' 


San DiAgo I 












Average Earnings 


Year 1 


K563 


$4,397 


$166 


4% 


Employed at End of 


Year 1 


53.3% 


53.7% 


-0.4 


"I/O 


Average AFDC Payments 


Yearl 


$2,289 


$2,664 


-$374*** 


-14% 


On Welfare at End of 


Year 1 


36.0% 


41.7% 


-5.7*** 


-14% 


San Diego SWIM 












Average Earnings 


\ear 1 




$2,806 


$500* 


18% 




Year 2 


4,294 




454 


12 


Employed at End of 


Year 1 


38.0% 


33.7% 


4.3* 


13% 




Yoar 2 


43.7 


37.2 


6.5** 


17 


Average AFIX Payments 


Year 1 


$4,883 


$5,300 


-$417** 


-8% 




Year 2 


3,897 


4,4^58 


-551*** 


-12 


On Welfare at End of 


Yearl 


6().3% 


62.8% 


-2.6 


-4% 




Year 2 


49.3 


50.5 


-1.2 


-2 



SOURCES: Data from Goldman, Friedlander, .md Long, 1986; Hamilton and Friedlander, 1989; and 
additional MDRC estimates of annual values. 

NOTES: The earnings and AFDC paym<^nts data include zero values for sample members not 
employed and for sample members not re Jiving welfare. Estimates are regressicn-adjusted using 
ordinary least squares, controlling for prt random assignment characteristics of sample members. 
Tlwe may be some discrepancies in experimental-control differences because of rounding. 

In the San Diego I program, year 1 begins with the quarter of random assignment. F-^r employment 
and earnings, the quarter of random assignment refers to the calendar quarter in which random 
assignment occurred. As a result, "average earnings" in year 1 may include up to two months of 
earnings prior to random assignment. For AFDC payments, the quarter of random assignment refers 
to the three months beginning with the month in which an individual was randomly assigned . In the 
San Diego SWIM program, where all outcomes were caltiilated for calendar quarters, year 1 begins 
with the quarter following the quarter of random assignment. 

"Employed" or "on welfare" at the end of the year is defined as receiving earnings or welfare 
payments at some point during the last quarter of the year. 

Earnings and AFDC payments are not adjusted for inflation. 

*Denotesstatistical significana^at the lOpercent level;**at the5 percent level;and ***at the 1 i>ercent 
level. 
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earlier study. In SWIM, there were impacts on earnings, employment 
rates, and welfare payments, with impacts continuing throughout the 
two-year follow-up period. While the majority of the AFDC-UPs were 
applicants, most of the welfare savings were for recipients; there was no 
similar pattern for earnings gains. 

The SWIM findings provide the first solid evidence of an AFDC-UP 
welfare-to-work program meeting the goals of producing both welfare 
savings and earnings gains. However, in terms of guiding JOBS 
administrators on program design, the knowledge base is approximately 
at the level it was for AFDC work programs in the late 1970s. 

Benefit-Cost Findings 

The preceding sections showed that most of the broad-coverage wel- 
fare-to-work programs evaluated to date produced sustained increases 
in employment and earnings and, to a lesser extev^t, welfare savings for 
single ptjrents; the SWIM study showed a similar pattern for adults in 
two-parent families. These impacts were obtained for an average public 
investment of between $11 8 and $953 per experimental. (This is the net 
cost per experimental, not per person actually participating in particular 
program components. Net costs include all expenditures incurred 
specifically for the program under study by the operating ageni t, plus 
any expenditures by other organizations on services that were an essen- 
tial part of the program treatment, minus the costs to the operating agen- 
cy or other organizations of serving members of the control group.'^) 

Researchers evaluating the seven programs also made a systematic 
effort to quantify a broader range of economic outcomes and compare 
them to their costs, using a benefit-cot>^ franiework. In doing this, they 
add ressed several questions: From a government budget perspective, do 
savings exceed the initial investment? From the perspective of welfare 
families, do the gains exceed the losses? In overall economic terms 
(considering society as a whole, including both families on welfare and 
others), do the benefits justify the expenses? As with any benefit-cost 
analysis, these studies have limitations and rest on a number of assump- 
tions. For example, certain benefits and costs were not measured (e.g., the 
value of society's preference for work over welfare or the various potential 



■ Stf Appendix A for a detailed discussion of net cost per experimental, using several 
alternative perspectives and definitions of costs. 
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effects on the children of women who participate in program services 
and, as a result, go to work). Estimates for others rest on assumptions 
about outcomes that were not directly measured (e.g., Medicaid savings) 
and the extrapolation of program impacts after the follow-up period (in 
this case, for a total of five years). 

The estimates of these programs' effects on government budgets 
showed that, while the programs required an initial investment, budget 
outlays were usually more than offset by projected savings over two to 

fiveyears.Forexample,theSanDiegoIprogramforAFIX:singlepa rents 
invested $636 per eligible person in the caseload and led to offsetting 
five-year savmgs from increased taxes and reduced AFDC, Medicaid 
and other transfer payments of $1,586, or $2.50 for each dollar of costs' 
The San Diego SWIM program returned $3 for every dollar of initial 
costs, and Arkansas led to even higher benefits per dollar of costs ^ 
Among the studies, the estimates from the Arkansas, Virginia, and Cook 
County programs for AFDCs also showed budget savings, as did the two 
San Diego programs for AFDC-UPs. The Baltimore and West Virginia 
AFDC programs incurred somesmall net costs. In four of thestates, more 
than half the savings went to the federal government. This provides a 
strong rationale for substantial federal participation in the funding of 
such programs, particularly in low-grant states. 

Benefits and costs can also be viewed from the perspective of the 
welfare recipients targeted for participation. For AFDC women the 
projected earnings gains associated with the programs usually exceeded 
the estimated reductions in welfare benefits and losses in other transfer 
payments, such as Medicaid and Food Stamps. In some of the programs 
however, gains in earnings approximately balanced reductions in 
transfers. AFDC-UP men broke even in SWIM (with their earnings gains 
about matching their losses from AFDC, other transfers, and tax 
payments). The men in the San Diego 1 study incurred net losses. 

Since benefits usually exceeded costs from both the government 
budget perspective and the perspective of the welfare eligibles targeted 
by the programs, the studies found positive results from the perspective 

^ The following section uses a somewhat different measure to show the relative cost 
eff.^t,venessoflow-orW^^ 

fit or net present value (benefits minus costs) per dollar of net invt-stmen it mmn.n'« 
the fmal years' earnings and welfare impacts p^r dollar of progr mTos^ ^ 
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of society as a whole - the measu re economists often use to judge wheth- 
er a program results in an economically efficient use of resources. 
(This perspective measures whether there is a net gain or loss in total 
social resources as a result of each person's involvement with the wel- 
fare-to-work program.) 

The Effect of the Program Model and Funding 

The preceding five sections have discussed what is known about 
broad-coverage programs in each of the three primary categories into 
which evaluation findings typically fall: participation (as part of the 
study of program implementation), impact, and benefit-cost analysis. It 
is also useful, however, to discuss these findings in the context of the 
framework for understanding the effects of state JOBS programs that 
was presented in Chapter 2, There it was suggested that particular fea- 
tures of a we)fare-to-work program - such as its "mandatoriness'' and 
target population - help define the program's nature and strength. The 
impact of these factors is examined in this and the next two sections, 
which are followed by a discussion of the research on the impact of the 
local economic and program context. 

Broad-coverage welfare-lo-work models can differ in the compo- 
nents, cost (and resulting cost-effectiveness), sequencing, and dura- 
tion of services. 

The Effect of Different Program Components. Unfortunately, the 
seven studies do not compare programs that differed on single dimen - 
sions, and only one - the first San Diego study -included a well-executed 
differential impact study.'^'' The strongest consistent evidence is for job 
search approaches. Six of the seven studies were of sequenced programs, 
where job search was the initial and most frequent activity. These results, 
combined with the earlier Louisville experiments (Goldman, 1981; 



I he research design in thrtn? evaluations (San Diego I, Virginia, and dryk County) 
includtKl a differential impact study, in which sample members were randomly assigned to 
either of two different treatment streams or to a control group, which was not eligible for 
either set of si.*rvices. In thest* studies, outcomes for the two service groups weie to be 
compared to each other and to the control group to isolate the differential effect of adding 
a work experience component to job search, or to job search and other activities. However, 
in two of these programs (Cook County and Virginia), only a small percent of the sample 
received the alternative treatment, resulting in participation patterns that were not suffi- 
ciently distinct to test the differential impacts of the two approacht.*s. 
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Wolfhagen, 1983), provide compelling evidence on the' long-term 
effectiveness of different forms of job search.^* The findings suggest 
that job search has almost always led to some increase in employment 
rates, but not to higher wages or longer hours (and thus higher earnings) 
for those working.^^ Job search has also usually resulted in some 
welfare savings. 

There is much less evidence on unpaid work experience. San Diego 
I included an experimental test of the incremental return from adding 
three months of unpaid community work experience (CWEP) after an 
initial job search program.*" The overall findings for AFDC applicants 
indicate that the addition of CWEP after job search did increase program 
effectiveness, but the lack of consistent results across cohorts enrolling 
during different labor market conditions suggests that, at most, the 
incremental impact was small. Thus, for AFDCs, there is some evidence 
of greater earnings (but not welfare) effects, but this evidence was driven 
by findings for the half of the sample that was enrolled during a period 
of economic recovery. For AFDC-UPs, there were inconsistent and 
contradictory impacts on employment versus earnings, ar.d on receipt of 
welfare versus the amount of welfare received. This lack of consistent 
findings from San Diego, and the absence of impacts from West Virginia's 
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Those studies also provide extensive information on how job search was implemented 
r" Pf ^^'"^'P^"^'^' ri-actions. See Gould-Stuart, 1982; Goldman ot al., 1985b; Quint and 

Employment and earnings information for the seven broad-coverage studii«icamefrom 
Unemployment Insurance earnings automated records (which contain quarterly earninKS 
and employment rates), rather than from surveys. The nature of this data st)urce does not 
allow researchers to determine how much of the gain in earnings came from increases in 
hours or week.-: worked versus hourly wages, although the combined effectof these factors 
on earnmgs could be measured. 

The C(H)k County study included a similar test, in which people were randomly assi;nn.-d 
to a program where work experience followed job search, or to a program without work 
experience, or to a control group. The authon; of that study concluded that there was no 
evidence that adding work experience increases! the IB-month employment, earr in^s or 
welfare impacts over and above those of job search alore. They did find that the addition 
of work experience led to a small but statistically significant decrease in welfare savings in 
the last few quarters of follow-up: Ilavings were lower for the job search and work 
experience sequence than for job search alone. (See Fnedlanderet al., 1987.) flowever the 
CcK)k County test addressed this differential impact issue less successfully than did'sai 
Diego !, since, as shown in Table 4.1, only 7.3 percent of the experimentals in the C(K)k 
County pb search/work expi'rience sequence actually participated in work experience 
compared to 13 percent in the San Diego I sequence. ' h-- 
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pure workfare program for AFDCs,^^ means that there is little evidence 
on whether unpaid work experience, following job search or alone, has 
an independent effect on program impacts (Goldman, Friedlander, and 
Long, 1986; Friedlander et al., 1986). 

In addition to providing information on program impact and 
cost-effectiveness, the 1980s studies also looked at how unpaid work 
experience was implemented and how welfare recipients viewed 
mandatory work requirements. In-depth interviews with a random 
sample of workfare supervisors and participants in six of the seven 
studies examined whether the positions were "punitive" and "make- 
work" or produced useful goods and services, provided dignity, and 
developed work skills. In an earlier volui.>e, Gueron summarized these 
results: 

• The jobs wore generally entry-level positions in maintenance, 
clerical work, park service, or human services. 

• Although the positions did not primarily develop skills, they 
were not make-work either. Supervisors judged the work 
important and indicated that participants' productivity and 
attendance were similar to those of most entry-level workers. 

• A large proportion of the participants responded positively to 
the work assignments. They were satisfied with the positions and 
with coming to work, and they believed they were making a 
useful contribution. 

• Many participants nevertheless believed that the employer 
got the better end of the bargain, or that they were underpaid for 
their work. In brief, they would have preferred a paid job. 

T hese f ind ings suggest that most states did not design or implement 
workfare with a punitive intent. This may explain results from the 
worksite survey that indicated thatthemajority of the participants 
in most s^ates shared the view that a work requirement was fair.^^ 



As noted (»arliur, the ARX'-uP study in West Virginia used a comparison group design 
and produced uncertain results. 

'^^ Gueron, 1987, p. 20. Sec Hoerz and H;^nson, 1986, for a summary of results from litudks 
in the six sitc^ plus New York City. Tht^» rtsuUs should not be ust»d to draw conclusions 
about workfc\re programs lastmg longer than (he typical 13-wt.vk assignments that were 
studied or involving the creation of so many positions in a site that the quality of individual 
job assignments would be affected. 
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Because so few of the broad-coverage programs included educa- 
tion, training, or on-the-job training (OJT) services, and because of the 
relatively short follow-up periods, they provide limited evidence on 
whether these services are successful in getting people into better jobs 
than they would otherwise obtain. The Baltimore program did seem to 
lead to an improvement in the type of jobs obtained (i.e., in wages or 
hours worked), and not just increased job-holding, but purprisingly 
showed no overall welfare savings. (Chapter 5 continues this discus- 
sion, focusing on what is known about the effectiveness of providing 
particular services as selective-voluntary components of broad-cover- 
age systems. It also presents separately what v/e know about three 
jOBS-relevant types of services: education, support services, and ser- 
vices targeted on young welfare recipients.) 

The Effect of Low- Veisus Higher-Cost Services. As indicated in a 
recent analysis by Friedlander and Gueron of these same seven 
broad-coverage studies, there are several alternative measures that can 
be used to assess the relative effectiveness of low- and higher-cost 
services: the average impact per enrollee, the impact per dollar outlay, 
the benefit net of program cost, the effect on income and poverty, and 
the impact on potential long-term recipients.'*^ 

Using the first measure (the one used in the second and third sections 
of this chapter), overall they find some support for the conclusion that 
programs that include some higher-cost, more intensive components 
(usually education and training) lead to larger absolute earnings gains 
per person in the study than those that provide only lower-cost job search 
and work experience.'^ (The evidence does not suggest that they pro- 
duce larger welfare savings.) This can be seen in Table 4.6, which 
summarizes impacts for programs listed in ascending order of net cost 
(defined, in most cases, as the operating agency's average cost per 
enrolled experimental minus its costs for controls) and also includes 



"^^Set' Fried la nd*.'r and GuerDiiy forthcoming, tor a detailed discussion t:f the evidence from 
welfare-to-work experimenfs on the relationship between cost and impact and the 
interpretation of these four measures. 

'^This is similar to the conclusion reached by Burtless, 1989, and Grossman, Mayiiard, and 
Roberts, 1985. 
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g TABLE 4.6 AFDC WELFARE-TO-WORK PROGRAMS: CHARACTERISTICS, COSTS, AND IMPACTS 



Program 
(Ordered by 
Increasing 
Net Cost) 



Annual Impacts for All Years of Follow-Up 



Program Activities and 
Study Ci'aracteristics 



Coverage/ 
Mandatoriness 



Net Cost Per 
Experimental 



Outcome 



Experimental- Percent Change 
Control Over Control 

Difference Group Level 



Broad-Coverage Programs 



Arkansas 


Sequence of group job search 


Mandatory; targeted $118 


Earnings 






WORK 


and (for a fow) unpaid work 


AFDC applicants 


Year 1 


$167** 


33% 


Program 


experience; controls excused 


and recipients with 


Year 2 


223 


23 




from all WIN requirements 


children 3 or older; 


Year 3 


337** 


31 




except assessment; low-grant 


few sanctions; 38% 










state; highly disadvantaged 


ever participated in 


AFDC payments 








population; evaluation 


job search or work 


Year 1 


-$145*** 


-13% 




began in 1983 


experience during 


Year 2 


-190*** 


-19 






9-month follow-up 


Year 3 


-168*** 


-18 



Lab-Individual 
Job Search 



Individual job search; 
controls eligible for 
regular WIN services; 
low-grant state; 
evaluation began in 1978 



Mandatory and volun- 
tary; targeted AFDC 
applicants and recip- 
ients with children 
of any age; 55% 
ever participated in 
individual job search 
during 8-month 
follow-up 



$136'^ 



Earnings 
Year 1 
Year 2 
Year 3 

AFDC payments 
Year 1 
Year 2 
Year 3 



$289**^ 
456**^ 
435**^ 



-575 
-184* 



18% 

2(3 

18 



-3% 
-8 
-10 




1^4 



Cook County 
WIN 

Demonstration 



Sequence of indi> idual jt b 
search and unpaid work 
experience; controls excused 
from all WIN requirements 
except orientation; program 
provided little direct assistance, 
mainly monitored and sanc- 
tioned those who did not 
participate; medium-grant 
state; highly disadvantaged 
population; evaluation began 
in 1985 



Mandatory; targeted 
AFDC applicants 
and recipients with 
children 6 or older; 
many sanctions; 39% 
ever participated in 
any activity during 
9-month follow-up 



Louisville WIN Group job search; controls Mandatory and volun- $230^ 

Lab-Group Job eligible for regular WIN tnry; targeted AFDC 

Search services; low-grant state; applicants and recip- 

evaluation began in 1980 ients with children 

of any age; 65% ever 
participated in group 
job search during 
6-month follow-up 



West Virginia Open-ended unpaid work Mandator}'; targeted $260 

CWEP experience; controls eligible for AFDC: applicants 

all other WIN services; rural and recipients with 

labor market with very high children 6 or older; 

unemployment; low-grant few sanctions; 247( 

state; highly disadvantaged ever participated in 

population; evaluation work experience during 

^ began in 1983 9-Tnonth follow-up 

vo 
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Earnings 

Yearl $10 1% 

AFDC payments 

Yearl .$40 -1% 



Earnings 

Year 1 $464**^ 43% 

AFDC payments 

Year 1 .$40'" -2% 



Earnings 

Yearl $16 4% 

AFDC payments 

Year 1 $u 0% 



(contittucd) 



TABLE 4.6 (continued) 



Program 
(Ordered by 
Increasing 
Net Cost) 



Program Activities and 
Study Characteristics 



Virginia ESP Scxjuence of indi vidua 1 or 

pi-oup job search, unpaid work 
experience, and some educa- 
tion or job skills training (but 
only slightly more than con- 
trols received on their own); 
controls excused from all 
WIN requirements; medium- 
grant state; disadvantaged 
population; evaluation began 
in 1983 



Coverage/ 
Mandatoriness 



Mandatory; targeted 
AFTXT applicants 
and recipients with 
children 6 or older; 
few sanctions; 58% 
ever participated in 
any activity during 
9-month follow-up 



Annual Impacts for All Years of Follow-Up 



Net Cost Per 
Experimental Outcome 



Experimental- Percent Change 
Control Over Control 

Difference Group Level 



$430 



Earnings 
Year 1 
Year 2 
Year 3 

AFDC payments 
Year 1 
Year 2 
Year 3 



$69 
280* 

268*^ 



-$69 
-36 
-111* 



5% 
14 
11 



-3% 

-2 

-9 



San Diego I Sequence of group job search 

(EPP/EWEP) and unpaid work experience; 

controls eligible for other WIN 
services; substantial program 
assistance provided; high-grant 
state; less disadvantaged 
population; evaluation began 
in 1982 



Mandatory; targeted 
AFtXT applicants 
with children 6 or 
older; many sanc- 
tions; 46% ever 
participated in job 
search or work 
experience during 
9-mor.th follow-up 



$636 



Earnings 

Year 1 $443* 

AFIXJ payments 

Year 1 -$226* 



23% 



-8% 



San Diego SWIM 



Sequence of group job search; 
unpaid work experience; and 
education and job skills train- 
ing; controls excused from all 
WIN requirements; high 
participation and ongoing 
participation requirement; 
high-grant state; less 
disadvantaged population; 
evaluation began in 1985 



Baltimore Options 



Choice of services; including 
individual or group job search; 
education; job skills fciaining, 
unpaid work experience; and 
on-the-job training; controls 
eligible for regular WIN 
services; program constrained 
to serve 1;000 enrollees per 
year; medium-grant state; less 
disadvantaged population; 
evaluation began in 1982 



Mandatory; targeted 
AFDC applicants 
and recipients with 
children 6 or older; 
many sanctions; 64% 
ever participated in 
any acdvity during 
12-month follow-up 



Mandatory; targeted 
AFDC applicants 
and recipients with 
children 6 or older; 
few sanctioas; 45% 
ever participated in 
any activity during 
12-month follow-up 




Earnings 

Yearl $352*** 21% 

Year 2 658*** 29 

AFDC payments 

Year 1 -$407*** -8% 

Year 2 -553*** -14 



Earnings 

Yearl $140 ?07c 

Year 2 401*** 17 

Year 3 51 i*** 17 

AFDC payments 

Year 1 $2 07t> 

Year 2 -34 -2 

Year 3 -31 -2 



(coutinued) 



^ TABLE 4.6 (continued) 
a 



Annual Impacts for All Years of Follow-Up 



(Ordered by 

Increasing Program Activities and 
Net Cost) Study CharacterisHcs 


Coverage/ 
Mandatoriness 


Net Cost Per 
Experimental 


Outcome 


Experimental- 
Control 
Difference 


Percent Change 
Over Control 
Group Level 


Selective-Voluntary Programs 


New Jersey OJT Subsidized on-the-job 

training; controls eligible for 
other WIN services; 
enrollees quite disadvantaged 
in terms of prior welfare 
receipt and recent work 
histories, but had relatively 
high levels of GED attainment; 
medium-grant state; 
evaluation began in \9M 


Voluntary; targeted 
selected AFDC 
recipients over 18 
with children of any 
age; 40% participated 
in employment with 
OJT (84% ever partici- 
pated in any WIN or 
JTPA activity) during 
12-month follow-up 


$787 ^ 
($439)*^ 


Earnings 
Yearl 
Year 2 

AFEXZ payments 
Yearl 
Year 2 


N/A*^ 
S591*^ 

-$19()**^* 
•238* 


N/A 
14% 

-6% 
-11 




Maine OJT Sequence of employability 

training, unpaid work expe- 
rience, and subsidized on-the- 
job training; controls eligible 
for regular WIN services; 
enrollees quite disadvantaged 
in terms of prior welfare 
receipt and recent work 
histoiies, but had relatively 
high levels of GED attainment; 
medium-grant state; 
evaluation began in 1983 



Voluntary; targeted 
selected unemployed 
AFDC recipients 
on rolls for at least 
prior 6 months, with 
childr en of any age; 
907( ever participated 
in any activity during 
12-morth follow-up 



$2,019 
($1,6351^ 



Earnings 
Year 1 
Year 2 
Year 3 

AFDC payments 
Year 1 
Year 2 
Year 3 



$104 

871** 
941 J 



$64 
29 
80* 



If 



8% 

38 

34 



2'/. 

1 

4 



AFDC 

Homemakeiw 
Home Health 
Aide 

Demonstrations 



National 
Supported Work 
Demonstration 



Job skills training and 
subsidized employment 
program; varied populations- 
low-, medium-, and hi;;h-grant 
states; evaluation l>egan 
in 1983 



Voluntary; targeted 
selected AFDC 
recipients on rolls 
for at least 90 Jays 
who were not employed 
as home health aides 
during that time; 84% 
participated (i.e., 
entered training) 



$9305 Earnings 
($5,957-$! 2,457 Year 1 
across states) Year 2 



($5,684) 



Year 3 

AFIXand Fofxi 
Stamp benefits 

Yearl 

Year 2 

Year 3 



Structured, paid work expe- 
rience; targeted extremely 
disadvantaged AFDC 
recipients; low-, medium-, and 
high-grant states; evalua- 
tion began in 1976 



Voluntary; targeted 
selected AFDC 
recipients on rolls for 
30 of prior 36 months, 
with children 6 or 
older; 97% participated 
(i.e., showed up for 
their program jobs) 



$17,981^ 
($9,4471 



Earnings 
Yearl 
Year 2 
Year 3 

AFDC payments 
Yearl 
Year 2 
Year 3 



$2,0268 
1,3478 
1,1218 



-$6968 
-8558 
-3438 



$6,4 J2***^ 
1,368**'^^ 
1,076***^ 



-$Z20()*»\ 
-1,165**»* 
-401**^ 



N/A 
N/A 
N/A 



N/A 
N/A 
N/A 



327*7 
36 
23 



-39% 

-26 

-10 



SOURCES: Data from the reports listed at the end of Chapter 1 and additional MDRC estimates, 

NOTES: The cost estimates repi^rted in this table are the net costs of thtH;e programs. These include all expt^nditures incurrcni specifically for the oroitrams 
understudybytheopc.atmgagenc>^plusany 

costs to the operating agency or other organizations of sc^rving membc^rs of the control groups. Set^ Appendix A for further diSon 
Net costs and annual impacts aro in nominal dollars except where noted. 
*The net cost is adjusted to 1985 dollars. 

(amtinued) 
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Nile impact is adjusted to 1985 dollars. Year 1 begins with the quarter of random assignment. Theannual earnings impact for year 3 is based on one 
quarter of follow-up. The annual AFEXT payments impact for year 3 is based on three quarters of follow-up. Statistical significance was not calculated for 
year 3. fiowever, since the quarterly impacts ^.re statistically significant; the annual impacts are assumed also to be significant. 

^The impact is adjusted to 1985 dollars. The annual earnings impact is based on two quarters of follow-up. Statistical significance was not calculated. 
However, since the quarterly impacts are statistically significant; the annual impact isassumed also to be significant. The annual AFDC' payments impact 
is based on four quarters of follow-up. 

^e bracketed figure excludes wage subsidy payments for participants; whereas the other figure includes them. 

^ A year 1 earnings impact is not available in New Jersey for the same sample as the year 2 impact and is therefore not shown. The annual earnings impact 
for year 2 is based on three quarters of follow-up. Statistical significance was not calculated for year 2. However, since the eamingii impact for quarters 
5-7 is statistically significant, the annual impact is assumed also to be significant. Similarly; the quarterly AFDC payments impacts for quarters 2, 3, and 
4 of year 1 are statistically significant; su the annual impact is assumed also to be significant. 

Unnual earnings and AFDC payments impacts for year 3 are based on three quarters of follow-up. Statistical significance was not calculated for year 
3. However, since the quarterly earnings impacts are statistically significant, the annual earnings impact is assumed also to be significant. 

*k:ross-state annual impacts are estimated from state-specific impacts presented in Table 5.2; so statistical significance and experimental and control 
groupmeansarenotavailable. Year 1 isdefined by theoriginalresearchersasthenumber of months from random assignmentuntil the typical experimental 
left subsidized employment. Year 2 is defined as the 1 2-month period following the time when the typical experimental left subsidized employment. Year 
3 is based on all months in the follow-up period after year 2. Average annual impacts .or each year were calculated by multiplying the average monthly 
impacts for that period by 12. Total earnings of the experimental group include bt>th demonstration and non-demonstration earnings. Since the 
Homemaker-Home Health Aide Demonstrations offereduptoayearof subsidized paid employment; eamingsand consequently reduced AFDCand Food 
Stamp benefits during the first two years partly reflect wages earned in the program, and not post-program impacts. In year 2, there were statistically 
significant gains in monthly earnings in all seven states and welfare savings in six. In year 3, there were significant gains in monthly earnings in five of 
the seven states and welfare savings in four. 

Supported Work projects generated revenues of $4,352 per experimental (in 1985 dollars); which offset part of the cost reported here, 
^he impact is adjusted to 1985 dollars. Since Supported Work offered up to 18 months of subsidized paid employment, earnings and consequently 
reduced AFIX: payments during the first two years partly reflect wages earned in the program, and not post-program impacts. The annual earnings and 

1( w \ AFDC payments impacts for year 3 are based on quarter 9, the last quarter for which there are common follow-up data for all recipients who responded 
i7 U to the final survey. AFDC payments impacts include impacts on General Assistance, Supplemental Security Income, and other unspecified cash welfare, 
g \^(^ "Denotes statistical significance at the 10 percent level; at the 5 percent level; and **» at the 1 percent level. 
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information on four selective-voluntary programs, which are discussed 
in Chapter 5,^^ While the table shows tha t even the very low-cost Arkansas 
program had persistent effects, average earnings impacts in the final year 
of follow-up tended to increase with cost. Thus, impacts were larger for 
San Diego SWIM anJ Baltimore than for San Diego I and Virginia. In 
contrast, average welfare impacts showed no clear relationship to cost; 
There were no welfaresavings in Baltimoreandclearsavings in Arkansas. 

In interpreting the table, it is important to remember that differences 
in program impacts may be attributable to factors other than cost (i.e., to 
the other dimensions discussed in Chapter 2). For example, programs 
that serve more disadvantaged persons are likely to have different 
impacts than those serving less disadvantaged persons; low-cost pro- 
grams may be more effective in low-grant than in high-grant states;^ 
programs that make limited use of sanctioning may have different 
impacts than those that sanction frequently. (Table 4.6 includes some of 
the information relevant to interpreting this cost-impact relationship. It 
lists as program activities only those components in which experimen- 
tals' participation exceeded controls' and notes when this increase in 
service was small. For example, in Virginia, a substantial number of 
experimentals participated in education and training but, as indicated in 
the discussion of Table 4.1, so did controls; thus, the program led to an 
increase in services for only a few people.) 



In almost all cast^, impacts aro stattnl in nominal dollars, not adjusted for inflation, with 
the evaluation's starting date shown in the table. The exceptions are the two U)uisville joH 
search programs and Supported Work, which began before l^MO and where ignoring the 
effc^cts of inflation would have been particularly distorting. Ek)th the costs and impacts for 
these programs have been inflated to 1985 dollars. While the same principles were used in 
calculating costs in most of these studit^s, the ^'arying availability of dria and different 
structures of the programs make some of the estimates not directly comparable. For 
example, in Supported Work, valutas from the mid-197l)s were inflated to 1985, which may 
overstate b>oth the costs of opt»rating the program and the wages earned by program 
graduates, given the limited increase in the minimum wage during these years. In addition, 
the costs of all of the H»lective-voluntary programs include the subsidized share of wages 
pjid to program participants. These were a particularly high fraction of average costs in th? 
Supported Work Demonstration and rt»sulttHl in offsetting AFDC savings, which are show i 
separately in the tablebut not deducted from costs. Finally, for budgetary purposes, thecest 
of Supported Work should also be reduced because the programs generattnl partially 
offsetting revenue from thesaleof giKxis and services the programs produced . (See the notes 
to Table 4.6.) 

The two low-cost job search programs that had impacts on employment and welfare 
receipt W(»re both iinplemenled in low-grant statt»s - Kentucky and Arkansas - where even 
a Iow-wagi» job would rc»sult in a case closure. U is not clear whether a similar program 
would have been equally successful, for example, in California. 
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In particular, it is not clear whether the larger earnings gains in San 
Diego SWIM and Baltimore reflect the use of some more intensive 
services or other aspects of the program or environment: e.g., the scale 
and local conditions, the extensive experience and capability of the 
programs' administrators, or the strong enforcement of the ongoing 
participation requirement in the SWIM saturation demonstration.^^ 

Turning to the second measure - impact per dollar invested in the 
welfare-to-work program - Friedlander and Gueron find that the addi- 
tion of cost considerations changes the picture substantially. They note 
that as long as costs were above a threshold level (not met in Cook 
County),**** there seems to have been an inverse relationship between a 
program's average cost and its earnings impact/cost ratio: i.e., the 
higher the program cost, the lower the earnings gain per dollar outlay.'*'' 
Based on this, they conclude that cost-effectiveness - using this partic- 
ular measure - appt'ars to have decreased from low- to higher-cost 
systems, apparently because the higher-cost systems used a combina- 
tion of low-cost job search and work experience enriched with more 
expensive components such as education, training, and OJT, and the 
latter components seemingly had lower impact per dollar outlay. The 
relationship for welfare impacts was less consistent, but also sug- 
gested diminishing returns in moving from programs that began with 
job search (either as the only service or followed by other activities 



In terms of sc ale - which tould affect placements and thus program impads - Virginia 
served the full mandatory cast^load; Baltimore coven\i a cross station of the caseload, but 
tmly 1,(XX) people; San Diegu I served only welfare applicants; and San Diego SWIM 
uptTated in only two of the seven officers of the county's social services department. In 
terms of administrative capacity, the San Diego MK'ial sc»rvices department had a reputa- 
tion for unusual expiTtise, and the Baltimore Office of Manpower ResourcL»s - which ran 
Options ~ was among the most experienctni and highly regarded CETA/JTPA operators 
in the country. 

In dollar terms, C(H)k C.\)unty did not have a lower net cost per experimental than the 
Arktmsas and first Louisville prograris. However, in tht*se two low-grant areas staff 
silarits were lower than in Chicago. Thus, tht»C\H)k C ounty program may have spent the 
least in real tern^s. It alst) ustnl res4)urces differently, focusing on nK)nitoringand priKi*ss- 
ing people rather than providing direct servicers. 

^"^The impact per dollar outlay is obtainc^d by dividing the impact tstimatv for the last year 
uf follow-up by the net cosl (U)th from Table 4.6). Using thi*» measure, the annual earnings 
impaciperdollarinvcstc\i was50to7Fnentsin Virginia,SanDiegoly5WIMyand Baltimore 
compartni to $2 or more in Arkansi^s and the similarly low-cost '.ouisville jt)b search 
programs. Note that this measure the impact per dollar outlay - is not the same as the 
total benefit per dollar outlay used in the precc»cling section. 
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as pari of a mixed strategy) to those that provided mainly higher- 
cost components. 

Focusing only on this measure, Friedlander and Gueron note that, 
faced with a choice of using a fixed budget to provide either higher-cost 
services to a smaller number of enrollees or lowrer-cost (primarily job 
search) services to a much greater number, the latter strategy (as long as 
the services are above the threshold level) is more likely to maximize 
aggregate program impacts (i.e., the total sum of earnings impacts or 
welfare savings for all individuals exposed to the pr;.^j»ram).'*(The find- 
ings for the third measure - net taxpayer benefits - ar» similar to those 
for this other cost measure.) 

However, Friedlander and Gueron point out that many people are 
equally or even more interested in other measures of effectiveness, e.g., 
the ability of a program to red uce poverty or to prevent long-term welfare 
receipt. Because of the limited data collected in most studies, they note 
that there is very little evidence on whether higher-cost programs are 
more successful in increasing family income and reducing poverty, but 
there is evidence they are more likely to get people into jobs with higher 
wages or hours. There is an ind ication of this type of effect in Baltimore."^' 
There is also very limited information on whether higher-cost compo- 
nents are more succes;;ful with people who are more likely to be long- 
term recipients. Only Baltimore and SWIM had some more intensive 
services. As indicated in Table 4.3, the Baltimore program was not partic- 
ularly successful with recipients. Since SWIM's impacts for subgroups of 
recipients are not yet available, it is not clear whether the strongly pos- 
itive average impacts for recipients found in that study (see Table 4.4) 
extended to the most disadvantaged subgroups. As discussed in Chapter 
5, among the selective-voluntary programs. Supported Work had a 
strong record of effectiveness with very long-term AFDC recipients who 
had litlle or no prior employment. 



Ak indicah'd in ChapttT 2, hdwcver, statt^s usually do not f.xv a fixt\i budget limit that 
is inii^'X'ndent tif their choice of program approach. Particular JOBS sorvicts are often 
funded out of different agency budgets. Certain ones (e.g.; case management) may be paid 
for directly with JOBS funds, while others (e.g., skills training or education) may be 
provided by JTPA agencies or community colleges. Given the JOBS legislation's focus on 
interagency ciK)rdination, the welfare agency's real budget constraint will depend on the 
extent to which it can acct^ services from these other agencies. 

See also the discussion of the higheriost selective-voluntary programs in Chapter 5. 
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Friedlander and Gueron conclude their review by pointing to the 
operational implications of these findings and the major uncertainties 
that remain. In their view, the findings suggest that administrators may 
face a trade-off in meeting different program objectives: Programs with 
some higher-cost services may lead to greater impacts per person and get 
some people better jobs, but those with mainly lower-cost, job search 
services may get greater total impacts because more people are served. 
This may prompt administrators interested in achievements in both 
directions to favor a mixed mode (following the SWIM or Baltimore 
model), using a combination of lower-cost services to assure immediate 
welfa re savings and carefully targeted, more expensive services with the 
hope of benefiting longer-term recipients.^^ This mixed strategy would 
allow states both to target the more disadvantaged and to serve a 
relatively large share of the welfare population, two explicit goals of 
JOBS. The logic for this would also follow from what the research sug- 
gests about the strengths and limits of past approaches. Job search has 
been demonstrated to have consistent employment and welfare impacts 
and to be cost-effective, but also to leave many without work and on wel- 
fare, especially among those who are more disadvantaged. A program 
like SWIM, which contains some higher-cost activities, and some of the 
selective-voluntary programs discussed in Chapter 5 have benefited the 
more disadvantaged in the JOBS population (on-board recipients), and 
SWIM and Baltimore suggest that including some higher-cost services 
(beyond job search assistance) can increase the j:>ercent of people with 
somewhat higher earnings. In addition, there is uncertainty about the 
point at which any trade-off among program objectives would be affect- 
ed by program scale; it is possible (although there is no evidence on this) 

that diminishing returns may set in if particular welfare-to-work services 
are provided to ar expanded share of the caseload. 

While this analysis of past studies sugj^ests a possible trade-off in 
meeting diverse program objectives, the nature of this trade-off and its 



SWIM was more successful than Baltimore in mwting tht»se diverse goals, since it 
obtaintsJbdthunusually large weliaresiU'ingsand relatively largeeamings gains. Baltimme 
achieved only the latter. This difference may liave followcHj from SWIM's greater reliance 
on job search, or from its much more mandatory implementation and resulting higher 
participation (see Table 4.1 ), or from other differences in the program approachc»s. 
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relevance to JOBS remain highly uncertain. There are a number of rea- 
sonr for this and hence for caution in using these resuhs. The completed 
studies are of broad-coverage programs that differed substantially from 
those emeiging under JOBS; i.e., they provided less education, skills 
training, and other intensive services; did not specifically target 
difficult-to-serve people or women with preschool children; and made 
less use of assessment and case mai^agement. The one program (Baltimore) 
that implemented the up-front assessment model emerging under JOBS 
was tested as a relatively small demonstration for 1,000 people, leaving 
unclear the feasibility of managing this process with similar resuhs at a 
much expanded scale. Follow-up was limited to at most three years, not 
an adequate time to determine the long-term return to larger invest- 
ments, or to see whether the impacts of low- or higher-cost services are 
more likely to increase or decrease over time. The number of completed 
studies is small and, as noted in Chapter 2, the programs differed on 
many other important dimensions in addition to cost, confounding an 
analysis of this relationship. In addition, the relative cost-effectiveness of 
low- and high-cost ser voices may not be the same under FSA as it was in 
the pre-JOBS period, if the introduction of a year of transitional child care 
a)' J Medicaid for people who leave welfare for a job reduces the total 
savings that occur when people lake low-wage positions. Finally, ad- 
ministrators may structure state JOBS programs with other objectives in 
mind: e.g., a state may emphasize education in the nope that this will 
have a positive effect on the children in welfare families or that it will 
upgrade the state's human capital as part of a broader economic de- 
velopment strategy. 

The critical importance of these issues to states deciding on the use of 
JOBS resources - in particular, those considering what services to provide 
to potential long-term recipients in the JOBS target groups who (where 
studied) were shown not to benefit consistently from lovv^-cost services - 
points to the need for further evaluations of different program approaches. 

The results from the current studies of more intensive programs - 
e.g., GAIN, REACH, and ET - will be of clear relevance. While those 
programs represent different strategies, each includes a greater emphasis 
on education and training than was typical in the mii-1980s. In audition, 
given the many competing explanations that inevitably arise when com- 
paring results across locations and studies, it wouid also be particularly 
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useful to try to address this issue directly, through Arell-designed 
differential impact studies, in which people in the same location are 
randomly assigned todifferent program approaches. Asdiscussed further 
in Chapter 5, which extends the discussion by drawing on the added 
lessons from the selective-voluntary demonstrations, these types of 
studies could be designed to deter .>ine the relative effectiveness of 
alternative moderate- to high-cost models, or of models with different 
cost, intensity, and objectives. If these could be successfully imple- 
mented, they would help clarify the relationship between program cost 
and the diverse measures of effectiveness. 

The Effect of Fixed Versus Open Sequence. The participation 
findings summarized in Table 4.1 point to the importance of how a 
program determines the first activity in which people are to participate, 
since a much smaller number reach subsequent services. There are two 
major options for structuring the fiow of people through a program and 
allocating resources for more expensive services: (1) fixed-sequence 
models (starting with job search), or (2) reliance on an assessment 
process, which may be more or less elaborate but usually involves 
substantial choice and gives attention to welfare recipient and case 
manager preferences. Deciding Ijetween these two options is critical 
in the design of a welfare-to-work program since, given resource 
constraints, this is the mechanism for determining who receives the 
more intensive services. 

Most broad-coverage models of the 1980s had a fixed sequence 
beginning with some form of job search followed by other activities for 
those who failed to locate jobs. This approach assumes that any type of 
employment will benefit recipients - regardless of their basic skills - 
because it moves them into the labor market, building a work history that 
can lead to long-term access to better jobs. From this perspective, 
low-income and welfare status a^ viewed, to a significant extent, as a 
result of limited work experienc job-seeking skills, references, and 
contacts, as well as a lack of self-esteem and motivation. Employment is 
seen as a way to provide tht^ experience that will build confidence and 
open doors. Some job search assistance programs focus on structuring 
the search in ways that help clients take advantage of the normally high 
turnover in entry-level positions. While proponents of up-front job 
search recognize that a mix of factors affect income, they argue that it is 
not possible to determine a priori who is or is not "employable." 



er|c l.^^G 



BROAD-COVERAGE PROGRAMS 



181 



Based on these assumptions, fixed-sequence models that start with 
job search use the labor market as a screening device to determine which 
people can get a job with minimal assistance and which need further 
employment-enhancing services, i.e., education or training, thereby 
focusing more expensive services on the population most in need. Job 
search, in this case, is viewed as an alternative to a more comprehensive, 
initial assessment, although assessment may follow job search. Propo- 
nents of this view also argue that even if welfare recipients fail to become 
employed during the job search component, they gain valuable 
information on .what they need to do to become employed. 

The assessment/choice model is based on a different view of how 
clients should be matched to services and how more expensive services 
should be rationed: that there is no single cause of low income and no 
single "treatment" appropriate for all people. Instead, the particular 
barriers to employment and self-sufficiency and needs for service should 
be identified through testing, counseling, and other means, and an 
individualized plan developed, with both case managers and welfare 
recipients influencing the nature and sequence of services. Involving 
welfare recipients in the process is seen as a way to help them define their 
goals and to motivate them to take the steps needed to achieve those 
goals. Proponents of this approach argue that it will result in a more 
appropriate sequence of activities, lead to an increase not only in 
job-holding but also in the quality of the jobs, and reduce the extent to 
which people finding jobs subsequently return to welfare. 

Unfortunately, while there is extensive information on up-front job 
search programs, there is only one completed impact study of a 
broad-coverage program - ihe Baltimore program - that used assessment 
and emphasized client choice. As a result, the relative effectiveness of 
these two approaches is not clear. The findings on job search, however, 
indicate that it is difficult to determine in advance who will find a job 
through a job club. (See the discussion of this issue in the section on 
"Findings on Subgroups and Targeting" in Chapter 5.) The New Jersey 
REACH, Washington FIP, Pennsylvania Saturation Work Program 

(PSWP),andMassachusettsETstudiesshouldprovidefurtherinformation 
on participant flow and impacts of non-fixed-sequence programs. The 
GAIN evaluation is examining a fixed-sequence program in which many 
participants are assigned to education, thus broadening the knowledge 
base on the effects of sequenced services. 
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The Effect of Mandating Participation 

As noted in Chapter 2, among broad-coverage programs, manda- 
tory ones may have greater impacts than voluntary ones because they (1 ) 
reach more - and more disadvantaged ~ people, (2) deter people from 
applying for or remaining on v^elfare, or (3) sanction people. On the 
other hand, it is also possible that voluntary programs may have larger 
impacts because they serve more motivated people, u^ho v^ill take 
greater advantage of program services. Unfortunately, we have only 
limited evidence on these issues. 

People Served. The field experiments summarized in this synthesis 
do not provide clear evidence on v^hether more mandatory programs are 
able to reach more or different people. Programs that include a 
participation mandate vary in their enforcement of that requirement. 
Among the seven broad-coverage programs evaluated, three v^ere more 
likely to threaten or invoke sanctions for nonparticipation - San Diego I, 
SWIM, and Cook County - v^hile the others rarely used sanctions, and 
saw the mandate primarily as a means to get in the door people whom 
they would not normally reach. As indicated in Table 4.1, while SWIM 
had the highest longitudinal participation rate, the other two more 
mandatory sites did not have particularly high participation rates. 
Further, Table 4.6 suggests no evident relationship between either 
sanctioning or participation - both possible proxies for the extent to 
which a program was mandatory - and program impacts.^ However, 
swim's atypically strong impacts, overall and for the more disadvan- 
taged two-thirds of the caseload, may at least in part reflect that program's 
unusually strict enforcement of a continuous participation mandate. 

Comparisons between mandatory and voluntary programs are 
even more difficult. Since state WIN progra'ns have been more or less 
mandatory since the early 1970s, there is no information on 
broad-coverage, totally voluntary programs. The evaluation of the most 



^ For a contrasting opinion, sec Mead; 1986 nnd 1990. Mead argues that welfare- to- work 
programsmustbemandatoryiftheyaretosucceed.Hiscon elusion derivesfromhisdifferent 
view of how to measure program success: not by impact on employment, welfare, or 
self-sufficiency, but by the extent to which the program increases "work effort" (which he 
defines in terms of activity in program components). Measured against this goal of maximizing 
participation, mandatory prO);rams,heconcludes,aremoresuccessful. Mead also states that 
higher participation raises job enLies and, because it causes programs to reach more 
disadvantaged people, increases net impacts. 
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visible large-scale program that is primarily voluntary - Massachusetts' 
ET program - has not yet been completed.^ An interim report from this 
study, however, provides important information on the population 
reached^ Initial findings show that as of mid-1987, approximately one- 
third of all Massachusetts' FY 1987 adult AFDC recipients hud partic- 
ipated in activities such as training within the previous year. ET partic- 
ipation levels are clearly substantial for a voluntary, statewide program, 
and reflect an emphasis on recruitment (Nightingale et al., 1989). 

Some of the selective-voluntary programs discussed in Chapter 5 
(e.g.. Supported Work and Project Redirection) suggest that - at least at 
the relatively small scale at which they were implemented - they were 
able to reach very disadvantaged welfare recipients (Board of Directors, 
MDRC, 1980; Polit, Quint, and Riccio, 1988). Others (e.g., Maine's Train- 
ing Opportunities in the Private Sector - TOPS - program) targeted 
disadvantaged groups but served a more job-ready subset within that 
group (Auspos, Cave, and Long, 1988). Finally, programs such as JTPA 
reach a more motivated or advantaged group within the AFDC caseload. 
Evidence from several of these studies suggests that only a small share of 
potential eligibles volunteered for services. 

Deterrence. Advocates ofmandatory programs argue that, in addition 
to reaching different people, the persistent follow-up and threat and 
reality of sanctions will deter some people from going on welfare, cause 
some people not to complete a welfare application, and prompt others to 
leave the rolls to avoid the "hassle" of participation or because they were 
"smoked out" of u.^n^ported jobs. The field experiments of the 1980s 
provide only limited evidence. As d iscussed in the section on "Estimating 
Entry and Macroeconomic Effects" in Chapter 2, these studies were not 



In ET; participation in individual activities is voluntary, but registration for the program 
is required. A recent non-experimental study of ET (O'Neill, 1990) used a timeserit»s analysis 
to estimate the effect of the program on the size of the welfare caseload in Massachusetts. 
The author concluded that little if any of the reduction in the AFDC caseload during the 
1980s appeared tohavebeencaustniby ET. She also compared Massachusetts to other states 
in regard to the participation of single mothers in welfare or in work. She found that single 
women in Massachusetts had a higher probability of receiving welfare than single women 
in other states in all but two of the eigh^ years from 1980 through 1987, and she argued that 
ET did not reduce this effect, except possibly in 1984 (ET's first full year of operation). She 
also found that ET had no apparent effect on the likelihtKKJ of employment among single 
mothers. The methods used in this work, and the n^search questions pt)sed, are very 
different from those of the ongoing evaluation of ET or the field experiments discussed in 
this document. 
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designed to measure whether these initiatives deterred people from 
applying for welfare. On the other issues, the lack of any clear relation- 
ship between sanctioning rates and impacts argues against any consis- 
tent interpretation. For example, the San Diego I demonstration, with its 
relatively high participation and sanctioning rates, did not appear to 
deter new applicants from eventually getting on welfare. While 
the tough enforcement of participation requirements and relatively 
high sanctioning in SWIM may have led to some caseload reductions, 
the study did not distinguish these from other sources of higher 
program impacts. 

Sanctioning. In WIN and WIN Demonstration programs, ytaff 
could impose sanctions - reductions in the welfare grant for AFEXT case 
heads, or case closure for AFDC-UPs - on targeted persons who refused 
to participate without good cause.^^ Research findings, particularly for 
the Cook County program for single mothers, suggest that sanctioning 
can translate directly into some modest welfare savings.^ For the other 
six completed studies, it is uncertain what role sanctioring played in 
inert rising participation and producing proj^am impacts (see Tables 
4.1 and 4.2). For example, as noted above*, it it not clear whether the 
relatively large impacts for AFDCs and AiTDC-UPs in the SWIM Dem- 
onstration came from the relatively high sanctioning, the saturation 
mandate (with the resulting high and ongoing participation), the use of 
education and training services, or other conditions particular to San 
Diego (notably, the experience of the program staff). 

The Impact of Administrative Practices 

It has proven difficult to quantify the returns to different case 
management, assessment, and monitoring approaches. 

Case Management. The study of early GAIN implementation shows 
that counties organized case management in different ways and bad 
registrant-to-staff ratios that ranged from 50:1 to 200:1. While the authors 



Sanctioning rules differ under JOBS 

^ Qx>k County sanctioned a relatively high number (12 percent) of experimentals but, as 
noted in thediscussion of Table 4.1, a substantial number of controls were also sanctioned. 
The program's impact on net sanctioning probably does acmunt for some of the very small 
welfare savings that iKcurred, even in the absence of any earnings gains. But it is not the 
only explanation, since some of the savings also came from an increase in case closures, as 
additional people either left the rolls or had their cases closed for administrative reasons as 
a result of the program. 
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report that the higher rales did not seem to hinder reporting on atten- 
dance, they note that they did delay follow-up on nonparticipation and 
affected the nature of staff procedures for dealing with noncompliance. 
GAIN participation rates do not seem to be clearly related to registrant/ 
staff ratios, but GAIN staff indicated that these ratios did affect atten- 
dance for those participating (Riccio et al., 1989). While cross-county 
information in later GAIN reports should provide further insight on this 
question, the most important results are likely to come from the River- 
side, California, case management experiment. In this differential impact 
study, welfare-to-work outcomes will be measured for welfare recipients 
whose case managers have a caseload one-half the normal size and for 
welfare recipients whose case managers have a normal-size caseload. 
This experiment will be the first formal test of the impacts of intensive 
case management. 

Assessment. Assessments can be conducted in a wide variety of 
ways including case managers' use of objective and subjective 
characteristics, such as prior work experience, to make assignments to 
particular activities; participants' self-assessment and choice of program 
activity; and formal testing and recommendations by professional 
employment counselors. There is currently no reliable information on the 
effect of different assessment approaches (or the location of assessment 
in the sequence of activities) on program participation, impact, or 
cost-effectiveness. Moreover, none of the planned evaluations directly 
address this issue. 

Some early anecdotal evidence identifies issues that may arise in 
stater, implementing JOBS programs that rely on complex cross-referral 
and coordination among many agencies and that emphasize assessment 
and caseworker discretion. This evidence suggests that, unless there are 
clear procedures and, especially where there are large caseloads, a 
well-designed management information system (MIS), people can fail to 
show up at some point in the assessment process, and possibly be lost 
to the program. In programs with many < *^ops, steps, and cross-referrals, 
participation may thereby be reduced. The evaluations of REACH, 
FIP, PSWP, ET, and Ohio Transitions to Independence should 
provide further information on caseload flow in more complex and 
discretionary programs. 

Caseload Monitoring Strategies. Some of the relatively simple 
WIN and WIN Demonstration projects of the early and mid-1980s 
achieved relatively high participation rates with quite primitive manage- 
ment information systems support. Even in the more complex SWIM 
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Demonstration, staff relied partially on manual management systems. 
The early reports from the GAIN evaluation, however, suggest that the 
efficient managing of this complex program will require effective 
automated tracking systems in all but the smallest counties (Wallace and 
Long, 1987; Riccio et al., 1989). 

The Importance of Labor Market Conditions 
and Area Characteristics 

Chapter 2 pointed to several ways in which the local economic and 
program context can affect JOBS' impacts. 

Labor Market Conditions. Labor market conditions influence the 
characteristics of the welfare caseload and the ease with which both 
experimentals and controls find employment. While it is often held that 
program impacts will be larger in a strong labor market, a number of 
studies have found the opposite: greater impacts in a weak labor market, 
at least in urbanareas. In the study of San Diego's job search program, for 
example, earnings impacts were substantially larger for people entering 
the program during a severe economic downturn than for a group who 
entered during a period of economic improvement (Goldman, 
Friedlander, and Long, 1986). Similar results were found in the National 
Supported Work Demonstration (Board of Directors, MDRC, 1980).^' In 
both cases, this was because improved economic conditions benefited 
controls as much as they assisted experimentals. MDRC's study of West 
Virginia's work experience program indicated, however, that in rural 
labor markets with very high unemployment rates (peaking at 23 
percent - the nation's highest - in January 1983), program interventions 
may have limited success in improving employment prospects 
(Friedlander etal., 1986). MDRC conducted oneotherstudy of a welfare- 
to-work program in a rural area: in 7 of the 11 agencies in the Virginia 
study, all of which had stronger labor markets than did the West Vir- 
ginia study counties. In these rural Virginia counties, there were no 
significant impacts on any outcome measures, although the authors 



However, preliminary results from the Minority Ft;mak' Single I'arent (MFSP) 
Demonstration suggest that impacts were larger when economic conditions improved 
(Gordon and Burghardt, 1990). 

90 9 



BROAD-COVERAGE PROGRAMS 



187 



concluded that small sample sizes may have accounted for these results 
(Riccio et al., 1986). 

While results to date do not, therefore, suggest that - except under 
extreme and/or rural conditions - higher unemployment rates reduce 
program impacts, there have not been stu Mes of large-scale 
welfare-to-work programs that were conducted durmg a severe national 
recession. It is possible that this could undermine program impacts.^ In 
addition, few of the completed evaluations are of very large-scale 
programs. The impacts of such programs might be more limited if local 
employers were, for example, saturated by job placement demands from 
program participants. It is too early to know whether JOBS programs, 
relative to their local labor markets, will operate at a scale substantially 
beyond that of some of the larger 1980s WIN Demonstration programs. 

Characteristics of the AFDC Program. AFDC grant levels and 
administrative structures can affect program impacts in several ways. 
Grant levels influence the characteristics of people on welfare and the 
extent to which people can combine work and welfare. In low-grant 
states, caseloads will be more disadvantaged, and even low-wage jobs 
will lead to case closures. Thus, as shown in Table 4.2, employment rates 
were lower for both experimentals and controls in Arkansas than in any 
of the other programs except West Virginia. Further, only 5 percent of 
experimentals in the Arkansas study combined work and welfare in the 
third quarter of follow-up, compared to 20 percent of experimentals at 
the same time in San Diego's SWIM program (Friedlander et al., 1985b; 
Hamilton and Friedlander, 1989). 

With only seven completed studies, however, it is not possible to 
establish whether there is a clear relationship between grant level, 
program design, and program impacts. Moreover, a conclusion will 
depend on the nature of the comparison: On a percentage basis, impacts 
on earnings and AFDC dependence were largest in low-grant Arkansas 
and high-grant California; in dollar terms, impacts were much larger in 
San Diego than in Arkansas. 



^ Very deprtsstnl economic conditions could alto have other results. For example, a 
welfare-to-work program implemented during » period of extremely high unemployment 
may be more likely to affect other low-wage w<* *rs, who might be displaced by welfare 
recipients who find jobs as a result of the pn) .1. Past studies have not examined this 
possibility. 
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In terms of AFDC administrative structure, there is no clear rela- 
tionship between the magnitude of or variation in impacts and whether 
a program is state-administered or state-supervised and county- 
administered. Thus, although Arkansas, Virginia, and West Virginia all 
had state-administered programs, impacts were quite different in the 
two Arkansas counties studied, and participation varied substantially 
across counties in all four states.^^ Participation also varied across coun- 
ties in the county-administered system in California, where the GAIN 
study suggests substantial cross-county variation in program objectives 
and design. County administrative differences may also influence im- 
pacts in the ongoing Ohio LEAP, Ohio Transitions to Independence, 
and Florida Project Independence evaluations, among others. 

The Extent of Community Employment and Training Services. 
The availability of services from JTPA, community colleges, or other 
facilities will affect welfare dynamics (and outcomes for the control 
group), program cost, and the ease and extent to which administrators 
can implement more complex and enriched JOBS program^i. While it is 
often assumed that few WIN-mandatory welfare recipients receive 
education or training services on their own, the three of the seven 
completed studies of low- and moderate-cost programs where this 
was measured suggest substantial activity by members of the control 
group - and self-initiated activities by experimentals. 

Thus, in Virginia, 12 percent of control group members participated 
in education or training activities within 15 to 28 months after random 
assignment; in Cook County, 18 percent of controls did so within 9 
months of random assignment; and in San Diego SWIM, almost 28 
percent of controls participated in community college programs (basic 
education, continuing education, training, and college-level courses) 
within 2 to 3 years after random assignment (Riccio et al., 1986; Fried- 
lander etal., 1987; Hamilton and Friedlander, 1989). The SWIM findings 
illustrate the extent to which controls' access to these programs decreas- 
es the service differential between experimentals and controls and, 
^4)resumably, lowers program impacts. While an impressive 34 percent of 
- -experimentals attended community colleges within 2 or 3 years, this was 
an increase of only 7 percentage points over the control group level. 



County-specific impacts were not t>stimated in Maine, Virginia, or West Virginia. 



ERLC 



BROAD COVERAGE PROGRAMS 



189 



Information from Evaluations Currently 
Being Conducted 

Ongoing studies of broad -coverage programs promise to enlarge the 
existing knowledge base regarding welfare-to-work program?. The 
GAIN evaluation in California will provide the first impact data on a 
mandatory participation, education-baned program. GAIN provides a 
far more comprehensive set of services to its participants than have most 
previous statewide welfare-to-work programs: Job search, adult basic 
education, GED classes, English for speakers of other languages, job club, 
and some training ;*nd work experience are available in most counties. 
The impacts of this bundle of services will be measured in six counties; 
impact measures will include employment, earnings, welfare receipt. 
Food Stamp receipt, and, in four counties, registrant survey information 
on such outcomes as job characteristics (e.g., hours, wages, and fringe 
benefits), total family earnings and transfer income, efforts to look for 
work, reasons for not working (when applicable), educational degree 
attainment, and various attitudinal measures. Impacts on clients' literacy 
levels will also be measured in some counties. 

In addition, as discussed above, California has commissioned an 
evaluation of intensive case management in the GAIN program. In 
Riverside County, an experimental design has been implemented to test 
the effect of GAIN as carried out by high-caseload welfare workers ver- 
sus GAIN as carried out by low-caseload welfare workers. This differ- 
ential impact evaluation will be one of the few efforts to isolate the effect 
of alternative administrative arrangements on participants. 

The evaluation of Project Independence in Florida will measure la- 
bor market outcomes for adult women on AFDC with children age 3 or 
older. This group will be eligible for activities that may include job 
search, education, training, or work experience. Eligibility for particular 
services will be determined by the application of state "job-readiness" 
criteria. Job-ready participants are assigned to job search. The evaluation 
will thus shed light on the consequences of an array of services that are 
allocated according to guidelines designed to reserve the most expensive 
services for the less employable welfare recipients. 

The forthcoming report on tht Pennsylvania Saturation Work Pro- 
gram (PSWP) will provide participation and impact findings for a pro- 
gram that, like San Diego's Saturation Work Initiative Model (SWIM), 
was designed to test a program model with an ongoing participation 
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requirement. Under the PSWP model, AFDCs with children over 6 and 
AFDC-UPs received an assessment, whi :h evaluated participants' math 
and reading skills, vocational interests, job search knowledge, and social 
service needs. PSWP participants were then referred to activities that 
could include job-readiness training (including workshops, job clubs, 
and job search), CWEP, education, and vocational training. Controls in 
the evaluation were also eligible for many of these services through the 
existing Work Registration Program (WRP) in Pennsylvania. Asa result, 
the PSWP impact evaluation will provide information about the effects 
of enhanced case management and an ongoing participation require- 
ment, the two predominant differences between the PSWP program 
model and the WRP model that was in use for the control group. 

The comparison group studies of three programs will provide 
important information. New Jersey's REACH will analyze a broad- 
coverage program that emphasizes up-front assessment of participants, 
followed by a range of services. The ongoing evaluations of Washing- 
ton's FIP and Massachusetts' ET program will provide findings on 
broad-coverage, voluntary welfare-to-work programs. 

The evaluation of Ohio's Transitions to Independence program will 
provide impact data for two groups of AFDC recipients. For AFCXZ-UP 
recipients and for single parents on AFDC who have no children under 
age 6, there will be a random assignment evaluation of the effect of 
required participation in work-related activities. These include job club, 
subsidized employment, education and training, and work experience 
(C WEP). The study will take place in 1 5 cou nties. The second group being 
studied consistsofsingleparentson AFDC with one or morechildren un- 
der age 6. For this group, there will be a random assignment evaluation 
in one county (Montgomery) of a progran\ requiring an assessment and 
vocational counseling, and offering (but not requiring) the work-related 
activities described above. In tiddition, this treatment group received an 
offer of extended transitional child care and Medicaid if they become 
employed. When the transitional benefits provisions of the Family 
Support Act took effect, these transitional benefits became available to 
AFDC recipients in the control group; consequently, this evaluation will 
measure the impact of the timing and the message associated with 
transitional benefits. (See Table 3.5.) These studies will increase the 
knowledge base regarding nmgrams that emphasize work, and the 
Montgomery County experiment for recipients with preschcxil children 
will also provide information on the impact of a treatment that empha- 
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sizes significant transitional services that increase the incentives for 
work (Bell, Hamilton, and Burstein, 1989). 

The ongoing, rigorous evaluation of the Focd Stamp Employment 
and Training Program analyzes the effect of a broad-based work 
requirement for Food Stamp recipients. Enacted in 1985, the federal 
legislation, like JOBS, gives states considerable flexibility in designing 
and implementing a mandatory employment and training program for 
the Food Stamp caseload while setting national participation standards. 
The study should yield useful information about the design, admin- 
istration, and operation of the broad-based participation requirement, 
the choice between low-cost and more intensive service strategies, and 
the overall impact of the program on recipients' employment, earnings, 
and welfare receipt. The findings will not l/e directly generalizable to 
the AFDC population, however, since participants in AFDC work 
programs a:e exempt from participation in the Food Stamp Employ- 
ment and Training Program. Indeed, only 6 percent of the participants in 
the Food Stamp study were receiving AFDC benefits, and participants 
who were on AFDC were more likel)' to be enrolled in intensive training 
activities than in the more typical job search activities (Puma, Werner, 
and Hojnacki, 1988). 
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The Knowledge Base: 
Other Evaluations 
Relevant to JOBS 
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Chapter 4 presented what known about the effectiveness of broad- 
coverage, usually mandatory, welfare-to-work programs. This chapter 
focuses on particular services for specific welfare populations. It extends 
the discussion in cwo ways. In the first two sections, it focuses on what 
is known and being learned about the success of certain service, compo- 
nents that can be provided as part of a broad-coverage system. It does not 
repegi: the discussion of job search and unp«id work experience, which 
'vere tested at scale in the broad-coverage studies. Instead, it covers the 
substantial number of other rigorous evaluations that have focused not 
on the entire WIN or /OBS system in a location, but on components of that 
system or specific services provided through other delivery systems or 
special demonstrations. These have often involved higher-co&t services, 
have always been tested as voluntary components, and have usually been 
implemented at smaller scale. For JOBS administrators, these other stud- 
ies ran help get inside the "black box" of the total delivery system and 
inform trade-offs on critical program design choices, including whether 
the addition of higher-cost components can increase program effective- 
ness. Services identified as successful can then be considered for potential 
broader use within the JOBS system. 

The selective-voluntary programs discussed in the first two sections 
can thus be viewed as possible smaller-scale components within a 
broad-coverage JOBS program that contains a wide range of activities. 

Selective-voluntary programs may offeranaltemativemethod of placing 
welfare recipients in welfare-to-work activities, as compared to some of 
the fixed-sequence programs discussed in Chapter 4. There are various 
ways to structure selective-voluntary components within larger systems: 
Outreach and advertising campaigns can solicit applicants; welfare staff 
can encourage welfare recipients to volunteer; or an assessment process 
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can be used to assign potenHal participants to services.' The effective- 
ness of the program may be partly determined by the method of identify^ 
ing potential participants. States may regard selective-voluntary pri 

gramsnotasmodelstobecomparedtolow-costjobsearchprogramsbu^ 
as speafic targeting strategies for groups in need of parHcdaf ^vices 

what these studies suggest about the targeting of tugher-cost services 
to particular subgroups of welfare recipients. 

In its final three sections, the chapter shifts to cover briefly what is 
known from broad-coverage oi selective-voluntary programs al^u 
specific areas of particular relevance to JOBS: educThon Lvices ser- 
vices for young AFDC mothers, and support services. The chapter con- 
cludes with a discussion of how these different approaches uCge h- 
mto program-model combinations. togetner 

I mdings on Selective-Voluntary Programs 

There are a number of rigorous evaluations of two types of selecti ve- 
volunta^ programs: enriched, small-scale demonstJlLn ptgrls 
T "T^r^"' larger-scale, volunta^ s^r 

ectssor, the Comprehensive Employment and Training Act (CETA). 
Demonstration Programs 

There have been random assignment studies of four selective- 
voluntary demonstrations: two multi-state programs testing sub S zed 

"^^"""^ Wo'rk Demonstratin a d he 

AFDC Homemaker-Home Health Aide Demonstrations), the multi-site 

of activities (including pre-vocational training, work experience, 

WIN system (the mandatorinSw&hasvS'^" ' "^"""y "datory 

explained in Chapter 2) t " rcou^^^^^^^^ ''T '"^ P^^^""" 

either entrance to th,. commne^^^^^^ 

participation in thecorimnTE m ,nd^^^^ /'xed-sequence program) or continued 
demonshdiions discussS „ LT chan'^7^^^ ^^^^ 

enrollmentisvoluntar^but/on ^enmuff^^^^^^^^ «^°"P- '"'"al 

not continue to particff ^ ' ''''''' ^'^'-'V ^'d 
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and on-the-job training) in Maine.^ (Ncne of these studies focused on 
education and training, key JOBS activities.) 

Supported Work enrolled a very disadvantaged group of AFDC re- 
cipients (averaging more than 8.5 years on welfare) in a 12- or 18-month 
program of carefully structured and closely :iupervised paid work expe- 
rience with elements of on-the-job training. It led to increases in earn- 
ings and reductions in welfare receipt. As seen in Table 5.1, during the 
third year after enrollment in the program (based on one quarter's data), 
the experimentals earned an average of $1,076, or 23 percent, more than 
:he $4,703 earned by controls.^ In contrast to the pattern for the broad- 
coverage programs that provided mainly mandatory job search, earnings 
gains in Supported Work were driven primarily by increases in hours 
worked and hourly wages and less by an increase in employment rates. 
Researchers in that study concluded that wage increases accounted for 42 
percent of the total long-term increase in earnings and that an increase in 
hours accounted for another 18 percent. While the wage gain is encour- 
aging, the actual amount was not large: Wages rose 12 percent - from 
$3.69 to $4.1 2 in current dollars.^ These earnings gains were accompanied 
by welfare savings: a reduction of 7 percentage points in welfare receipt 
and $401 in estimated annual grants.^ Because reductions in AFDC and 
other benefits offset a substantial share of the increase in earnings. Sup- 
ported Work had no statistically significant long-term impact on the 



SeeChapter 3 for a description of the program approaches. Throughout th' .^ synthesis, the 
findings for all of the studies except Supported Work and the Louisville studies are 
expressed in nominal dollars. Both the costs and impacts of the Supported Work dem- 
onstration, which operated during the late 1970s, have been adjusted and are expressed in 
1985 dollars, roughly the midpoint in the other studies in Chapters 4 and 5. 

In Supported Work, 97 percent of the AFIXT experimental participated (i.e., were 
employed in program jobs). 

"^Masters, 1981. 

''The Supported Work earnings gainsand welfare reductions shown inTableS.l are based 
on a sample consistent for all years of follow up. In the original Supported Work study, 
this was not the case. Impacts for the first 18 months of follow-up were based on the maxi- 
mum sample of 1,351 individuals. Data for many of these individuals were not available 
beyond 18 months, and impacts for the 19- to 27-month period were estimated using only 
an early cohort of 620 enrk. jees (Board of Directors, MDRC, 1980). A subsequent set of 
impact estimates (C rossman, Maynard, and Roberts, 1985) — used in this synthesis, with an 
adjustment to 1985 dollars - incorporated more observations at the end of follow-up, 
which were available from a final survey wave. For example, 1,069 sample members 
were used for the 25- to 27-month follow-up perit>d, the last period with data for this 
full sample. Inflation to 1985 dollars may overstate the actual impacts that would have 
been achieved had the demonstration been run in the 1980s because it dt>es not take 
into account erosion of the real minimum wage and real AFDC benefits over time. 
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TABLE 5.1 IMPACTS OF THE NATIONAL SUPPORTED WORK 
DEMONSTRATION ON AFDC RECIPIENTS 



Outcome and 




Experimental 


Control 




Percentage 


Follow-Up Period 




Group Mean 


Group Mean 


Difference 


Change 


Average Earnings 


Year 1 


$8,360 


$1,958 


$6,402*** 


327% 




Year 2 


5,159 


3,791 


1,368*** 


36 




Year 3 


5,779 


4,703 


1,076*** 


23 


Employed at End of 


Year 1 


73.3% 


30.4% 


42.9*** 


141% 




Year 2 


46.6 


42.3 


4.3 


10 




Year 3 


45.3 


43.3 


2.0 


5 


Average AFDC Payments^ 


Yearl 


$3,472 


$5,672 


-$2,200** 


-39% 




Year 2 


3388 


4,553 


-1,165*** 


-26 




Year 3 


3,501 


3,902 


"401** 


-10 


On Welfare at End of 


Yearl 


70.4% 


85.9% 


-15.5*** 


-18% 




Year 2 


64.4 


73.5 


-9.1*** 


-12 




Year 3 


64.2 


71.3 


-7.1*** 


-10 



SOURCES: MDRC calculations from Grossman, Maynard, and Roberts, 1985; Hollister, Kemper, and 
Maynard, 1984. 

NOTES: All figures are adjusted to 1985 dollars. The data are regression-adjusted estimates that 
control for the differences of age, sex, race, education, prior work experience, household composition, 
and prior welfare receipt. Since only control group means and estimated impacts are available, 
experimental group means were calculated by adding estimated impacts and control group means. 

The follow-up period begins with the day of random assignment. Since Supported Work offered up 
to 18 months of subsidized paid employment, earnings and consequently reduced AFEXT payments 
during the first two years partly reflect wages earned in the program, and not post-program impacts. 
The annual earnings and AFDC payments impacts for year 3 are based on quarter 9, the last quarter 
for which there are common follow-up data for all recipients who responded to the final survey. 

Averages were calculated for all members of the sample, including those with no employment or 
transfer payment receipt in the covered period. 

"Employed" or "on welfare" at the end of years I and 2 is defined as receiving earnings or welfa'-e 
payments at some point during the last quarter of the year. For year ?. it is defined as receiving 
earnings or welfare payments at some point during the first quarter of the year 

^Includes AFDC, General Assistance, Supplemental Security Income, and other unspecified cash 
welfare. 

**Denotes statistical significance at the 5 percent level; and *** at the 1 percent level. 
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percentage of families living below the poverty level. In general, the 
impacts for Supported Work were largest for those recipients who did 
less well on their own: older women, women who had not completed 
high school those who had been on welfare for a particularly long time, 
and those with no prior work experience (Board of Directors, MDRC, 
1980; Hollister, Kemper, and Maynard, 1984). 

The Homemaker-Home Health Aide Demonstrations targeted wom- 
en who had been on AFDC for at least 90 days and reached a diverse 
group of welfare recipients, the majority of whom were WIN volunteers 
(i.e., had children under 6 years old). The program provided fou/ to eight 
weeks of formal training, followed by up to a year of subsidized employ- 
ment. It found, on average, results similar to those of Supported Work, 
with wide variation across the states, (See Table 5.2.) During the third 
year of follow-up (as defined in the table), there were significant in- 
creases in unsubsidized employment in four of the seven states and 
earnings gains in five. In that year, annual earnings gains averaged 
$1,121 across the states, with a state low of $132 and a high of $1,944 
(Bell, Enns, and Orr, 1986).*^ The factors that produced earnings gains 
were different in the Homemaker-Home Health Aide Demonstrations 
than in Supported Work. The Homemaker-Home Health Aide earnings 
gains came primarily from increases in employment rates, with consis- 
tent gains in wage rates in only two of the states with earnings increases.^ 
In all, four states showed positive impacts on trainees' hourly wage rates 
in year 3, and four had positive impacts on the number of hours worked 



The Homemaker-Home Health Aide study did not present findings averaged across all 
seven states. The authors of this synthesis volume derived all average numbers from the 
state results, weighing all states equally. In the Homemaker-Home Health Aide 
Demonstrations, approximately 84 percent of experimentals participated (i e., entered 
training) across all of the states except Texas, where 74 percent participated. Impacts per 
participant, as a result, are somewhat higher than those shown in Table 5.2. The 
per-participant impact on annual earnings in year 3 ranged from $144 in New York to 
$2,592 in Texas, with an average annual earnings impact across the seven states of $1,293, 
Public benefit savings per participant in year 3 ranged from $12 in Texas to $1,140 in 
South Carolina, with an average savings across the seven states of $382. 

Enns, Bell, and Flanagan, 1987, as discussed in Friedlander and Gueron, forthcoming. 
The three states with statistically significant gains in hourly wage rates throughout the 
post-program period had increases of between 29 and 88 cents per hour, or 8 to 19 percent 

above theaverage wages formembers of thecontrol groups. Theevaluators concluded that 
''productivity [and wage] gains were greatest in the southern and mostly rural states 
where, in general, wage rates are low relative to the more urban states" (Bell, Enns, and 
Orr, 1986, pp. 16-17). 



ERIC 



TABLE 5.2 IMPACTS OF THE HOMEMAKER-HOME HEALTH AIDE DEMONSTRATIONS ON AFDC RECIPIENTS 







Percent Employed 


in 


Average Annual Earnings in 


Average Annual Combined AFDC and 
Food Stamp Benefits in 


Site 


Year 1* 


Year 2^ 


Year 3'' 


Year 1 


Year 2 


Year 3 


Yeai 1 


Year 2 


Year 3 


Arkansas 


N/A 


N/A 




$1,536*** 


$1,392*** 


$1,116*** 


-$204*** 


-$684*** 


-$540*** 


Kentucky 


N/A 


N/A 


2 


1,980*** 


1,344*** 


1,860*** 


-996*** 


-1,008*** 


-432*** 


New Jersey 


N/A 


N/A 




3,744*** 


1,848*** 


1,344*** 


-1,740*** 


-1,212*** 


36 


New York*' 


N/A 


N/A 


-12 


240 


684** 


132 


348*** 


-168 


96 


Ohio 


N/A 


N/A 




2,844*** 


2,268*** 


1,212*** 


-972*** 


-1,020*** 


-564*** 


South Carolina 


N/A 


N/A 


3 


2,976*** 


912*** 


240 


-1 080*** 




-l,UUo 


Texas 


N/A 


N/A 


21*** 


864** 


984*** 


1,944*** 


-228*** 


-468*** 


12 


Cross-State 
Average^ 


N/A 


N/A 


8 


2,026 


1,347 


1,121 


'696 


-855 


-343 



SOURCE: IV.DRC calculations from Bull, Enns, and Orr, 1986. 

NOTES: All values are experimental-control differences. Experimental and control group means were not available. Impact estimates average net 
outcomes for all experimental^ including the small share who did not participate in the homemaker-home health aide sequence. The impacts on 
expenmentals who actually started training were somewhat higher in each state and substantially higher in Texas, where nonparticipation was higher. 

is 

I from 

..... , . n . . . .. . r o — typical experimental left 

subsidized employment. Ye«r 3 is based on all months in the follow-up peri.xl after year 2. Average annual impacts for each year were calculated by 
multiplying theaverage monthly impacts forthatperiod by 12. SincetheHomemaker-HomeHealthAideDemonstrations offered uptoayearof subsidized 
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TABLE 5*2 (continued) 

paid employment; eamingsand consequently reduced AFDC and Food Stamp benef^ ' during the first two yearu partly reflect wageseamed in the proeram, 
and not post-program impacts. / r / o ^ ^ , 

"•UnliJce the reported earnings impacts^ employment impacts were reported by the original researchers only for non-demonstration employment. By 
year 3 the typical experimental was no longer in subsidized employment; however; so the year 3 employment and earnings impacts both reflect 
post-program employment and are therefore comparable. 

^Impacts on AFDC and Food Stamp benefits do not include New Yo* * ity; where no data were available. 
*^Impacts on AFDC benefits only are available. 

*^Cross-state averages were calculated from the original researchers' state-specific estimates; so statistical significance is not available. 
** Denotes statistical significance at the 5 percent level; and *** at the 1 percent level. 
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per month. Theyear 3 earnings gains led to annual welfare savings in four 
of the states, ranging from $432 to more than $1,000 and averaging $343 
per year across all the states. 

The impacts of the Homemaker-Home Health Aide Demonstrations 
show considerable variation across the states, and there is very little 
relationship between the states with earnings gains and those with 
welfare savings. While the reason for this variation is unclear, the authors 
note that participating states were given substantial flexibility: Within 
overall demonstration parameters (e.g., eligibility requirements and the 
basic service components), they could impose their own additional 
criteria for acceptance of trainees into the program and devise their own 
training and service provision policies. 

The two studies of the on-the-job training programs operated as 
components of the WIN demonstrations in New Jersey and Maine show 
employment and earnings results on the high side of those found in the 
broad coverage programs. The New Jersey program offered OJT place- 
ments in the private sector of up to 6 months, but experimentals could 
also receive other WIN services. In Maine, there was a fixed sequence of 
services, consisting of 2 to 5 weeks of pre-employment training in job 
search and job-holding skills, up to 12 weeks of half-time unpaid work 
experience in the public or nonprofit sector, and then placement in an 
OJT-subsidized job in the private sector for 6 to 26 weeks.^ As shown in 
Table 5.3, the Maine program led to earnings gains, relative to controls, 
of $871 h\ the second year and almost $950 in the third. The New Jersey 
program led to earnings gains of almost $600 in the second year. (The 
Maine and New Jersey programs achieved most cf their earnings im- 
pacts by increasing the wage rate or hours for those employed, rather 
than increasing employment rates, i.e., by moving people into jobs with 



Overall about 90 percent of experimentals in Maine and 84 percent in Ni'w jersey 
participated in at least one activity within 12 months after random assignment, although 
a much smaller number ~ 31 and 40 percent, respectively were placed in OJT-funded 
jobs. (The major other activities were pre-vocational training, work experience; and some 
individual job search, in Maine;and job search in New Jersey.) Participation was also high 
by controls (who were WIN registrants and had volunteered for theOjT program) -higher 
than the participation by experimentals in many of the broad-coverage studies presented 
in Chapter 4. Thus, in Maine, over 50 percent of controls were active in some WIN or JTPA 
service (primarily individual job search, education, or pre-vocational training) within 
11 to 26 months after random assignment; in New Jersey, 73 percent of controls were 
active in some WIN or JTPA service (primarily job search) within 12 months of ran- 
dom assignment. 
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TABLE 5.3 IMPACTS OF THE NEW JERSEY AND MAINE ON-THE-JOB 
TRAINING PROGRAMS ON AFDC ELIGIBLES 



Location, Outcome, 



Experimental Control 



Percentage 



and Follow-Up Period 




Group Mean 


Group Mean 


Difference 


Change 


New Jersey 












Average Earnings^ 


Yearl 


N/A 


N/A 


N/A 


N/A 




Year 2 


$4,840 


$4,249 


$591* 


14% 


Employed at End of 


Yearl 


54.8% 


55.2% 


-0.4 


-1% 




Year 2^ 


56.1 




.1 7 


-3 


Average AFEX^ Pavments 


Year 1 


$3,188 


$3,377 


-$190**^ 


-6% 




Year 2 


1,946 


2,184 


-238* 


-11 


On Welfare at End of 


Year 1 


65.8% 


68.6% 


-2 R 


-4% 




Year 2 


45.7 


47.5 


-1.9 


-4 


Maine 












Average Earnings*^ 


Yearl 


$1,466 


$1362 


$104 


8% 




Year 2 


3,183 


2,311 


871** 


38 




Year 3 


3,700 


2,759 


941* 


34 


EmolovcKi At Fnd nf 


Year 1 


52.1% 


43.8% 


8.3 


19% 




Year 2 


50.2 


43.4 


6.9 


16 




Year 3*'* 


50.4 


49.3 


1 1 
1*1 


2 


Average AFDC Payments'^ 


Yearl 


$3,419 


$3,355 


$64 


2% 




Year 2 


2,609 


2,580 


29 


1 




Year 3 


2,191 


2,110 


80 


4 


On Welfare at End of 


Yearl 


81.8% 


85.1% 


-3.3 


-4% 




Year 2 


64.4 


63.1 


1.3 


2 




Year 3^ 


55.8 


49.8 


6.0 


12 



SOURCES: MDRC calculations from Freedman, Bryant, and Cave, 1988; Auspos, Cave, and Long, 
1988. 

NOTES: The earnings and AFIX! payments data include zer.) values for sample members not 
employed and for sample members not receiving welfare. Estimates are regression-adjusted using 
ordinary least squares, controlling for pre-random assignment characteristics of sample members. 
There may be some discrepancies in experimental-control differences because of rounding. 

"Employed" or "on welfare" at the end of the year is defined as receiving earnings or welfare 
payments at some point during the last quarter of the year. 

Earnings and AFDC payments are not adjusted for inflation. 

**A year 1 earnings impact is not available in New Jersey for the same sample as the year 2 impact 
and is therefore not shown The annual earnings impact for year 2 is based on three quarters of 



(cotititiued) 
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TABLE S*3 (continued) 



follow-up. Statistical significance was not calculated for year 2. However; since the earnings impact 
for quarters 5-7 is statistically significant, the annual impact is assumed also to be significant. 
*^Percent employed at the end of 1 3/4 years. 

Statistical significance was not calculated for year 1. However; since the quarterly impacts for 
quarters 2, 3, and 4 are statistically significant; the annual impact is assumed also to be significant. 

'^For all outcomes; year 1 begins with the quarter of random assignment. The quarter of random 
assignment refers to the calendar quarter in which random assignment occurred . As a result; "average 
ea mings" and "average AFDC payments" in year 1 may include up to two months of earnings or AFDC 
payments pnor to random assignment. Annual earnings and AFDC payments impacts for year 3 are 
based on three quarters of follow-up. Statistic! I significance was not calculated for year 3. However; 
since the quarterly earnings impacts are statistically significant; the annual earnings impact is 
assumed also to be significant. 

*^Percent employed and on welfare at the end of 2 3/4 years. 

♦Denotes statistical significance at the 10 percent level; and ** at the 5 percent level. 
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higher earnings.^ An analysis in Maine, not repeated in New Jersey, 
showed that that program also led to a substantial 9.3 percentage point 
increase in the proportion of people earning $8;300 a year or more in the 
final year of follow-up. This pattern of impacts more closely resembled 
the Baltimore program than the broad-coverage, job search programs.) 
These gains were accompanied by welfare savings in New Jersey but, 
surprisingly, not in Maine, suggesting that in Maine, as in Baltimore, part 
of the earnings gains may have come through getting jobs with higher 
earnings for people who would have moved off welfare and obtained a 
lower-paying job in the absence of the program (as shown by the 
behavior of the control group).'^ (See Auspos, Cave, and Long, 1988; 
Freedman, Bryant, and Cave, 1988.) 

Enrollment in the New Jersey and Maine programs was voluntary, 
both for women with children over age 6 and the traditional WIN 
"volunteers" with younger children. While the New Jersey program 
targeted "employable" WIN participants, the Maine program sought to 
enroll a more disadvantaged group of women. In fact, both programs 
screened for motivation and employability and, as a result, enrolled 
women with a mixture of characteristics. They were quite disadvantaged 
in terms of their prior welfare receipt and recent work histories, but had 
relatively high levels of GED attainment and high school completion. 



In these two studies, as in the broad-coverage evaluations discussed in Chapter 4, 
employment and earnings came from Unemployment Insurana» earnings automated 
records, rather than surveys, as was the case in Supported Work and Homemaker-Home 
Health Aide. As a result, while it was possible to determine the extent to which earnings 
gains came from increases in employment rates versus either hours worked or hourly 
wages, there was no information on how much of the change could be a ttributed to each of 
the latter two components. 

The study, after determining that there was no problem in data quality or program 
procedures, offered several possible reasons for the lack of impact on AFDC payments. 
First, Maine was one of a small number of states where the AFDC standard of need exceed- 
ed the maximum grant and where the standard of need was used to determine supple- 
mental grants to working recipients. As a result, the amount by which grants were 
reduced when someone went ic work was lowered, and work incentives were increased. 
Second, any impact for experimentals above the point where earnings were already 
sufficient to remove them from the rolls would not have led to any further welfare 
savings. Third, one of the program components instructed participants about the 
relationship between work and welfare, possibly increasing their effectiveness in 
assuring that their grants were not improperly reduced when they went to work. 
Fourth, there may have been welfare savings for those who found employment which 
were offset by an increase in the time on welfare for other people, e.g., those engaged 
in longer-term training programs. Sec Auspos, Cave, and Long, See also Appen- 
dix Table C.l for more detailed data on the impacts of this program. 
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This recruitment and screening is typical of past OJT programs and may 
be similar to the practice in this component in JOBS. Consequently, the 
results, particularly those for the larger-scale New Jersey program, may 
be directly relevant to similarly targeted OJT activities in future state 
JOBS programs. 

These demonstrations made greater up-front investments per ex- 
perimental than did the lower-cost broad-coverage programs, with the 
expectation that returns would take longer but eventually be larger. The 
impact findings provide some support for both parts of this expectation. 
In both Maine and the mixed-strategy Baltimore program, impacts were 
low in the first year and grew consistently over the period of follow-up. 
(Obviously, this was not the case in the Supported Work and Home- 
maker-Home Health Aide demonstrations, which provided jobs with 
subsidized wages to people while they were in the program.) On job 
quality, all of the selective-voluntary programs and the Baltimore pro- 
gram appeared to increase the wage rates or hours of those working, 
rather than having their effect mainly through increasing employment 
rates, as the job search programs did. (The selective-voluntary pro- 
grams, in fact, often had relatively small or no effects on the percentage 
of people working.) 

However, the impact findings on selective-voluntary programs 
point to another lesson as well. While they suggest consistent and 
relatively large earnings gains, they also suggest clear limits. Increases 
in total income were still not large. As a result, the programs may have 
modestly improved people's standard of living, but were unlikely to 
move many people out of poverty, suggesting the limited potential of 
even these programs to help most welfare recipients work their way out 
of poverty, at least within the three years of follow-up. This points to the 
importance of determining whether programs that make a more con- 
scious investment in increasing human capital can do better, and con- 
tributes to the continuing policy interest in complementary policies 
directed at providing more income to the working poor. 

While the selective-voluntary programs' impacts on earnings were 
relatively impressive, from the perspective of government budgets in a 
benefit-cost context, the mixed impacts on welfare savings led to very 
varied findings. The Maine and Homemaker-Home Health Aide dem- 
onstrations did not break even. The New Jersey and Supported Work 
programs produced net savings for the government, the former within 
three years and the latter over a substantially longer period. 
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Table 4.6 provides a summary of the estimated impacts for the 
brodd-coverage and selective-voluntary programs, ranking both sets of 
programs by the net cost per experimental and indicating some of the 
features of each study that affect the interpretation of its findings.'^ 
Comparison across studies suggests that Supported Work, the 
Homemaker-Home Health Aide Demonstrations (and, to a lesser extent, 
the Maine OJT program) had higher average costs, but also higher 
average earnings impacts, than the broad-coverage programs. 

The section on "Estimating Impacts for Broad-Coverage and 
Selective- Voluntary Programs'' in Chapter 2 outlined a number of rea- 
sons why comparisons between the two categories of studies may be mis- 
lead ing: Differences may reflect not only the relative effectiveness of the 
employment-directed services, but also variations in either targeting 
or the research design and resulting participation rates. (Also, the selec- 
tive programs served volunteers, while the broad-coverage ones prob- 
ably included people who, on average, were less motivated .) On the first 
point, targeting, the studies unfortunately do not always provide sim- 
ilar data on participants' measured characteristics, so it is not possible to 
assess the extent to which the programs reached similar or different 
groups in the caseload. Obviously, the broad-coverage programs in- 
volved a heterogeneous group, including people uninterested in pro- 
gram services (some of whom had left welfare). The voluntary programs 
reached varied and often unspecified subgroups. For example. Sup- 
ported Work targeted very disadvantaged long-tenn recipients, while 
the Homemaker-Home Health Aide Demonstrations*^ appeared to tar- 
get no clearly identifiable group, but reached a small number of moti- 
vated volunteers.^'* 



All ciisls and impncts .ire in nominal dtiM.us, with the exceptinn nf Supported Work and 
the Louisville studies which were conducted during an earlier period and for which the 
results are expressed in 1985 dollars (the approximate midpoint of the other studies). 

Set? Fried lander and Gueron, forthcoming, for further discussion of the non-compara- 
bility of these two types of studies. 

Data from the lattor study indicate that fever than 3 percent of all AFDC recipients 
contacted bythe program (primarilythroughnass mailings) actually applied for training, 
and fewer than 2 percent were accepted into tne study (Cella, 1987). 

The behavior of control group members d(K»s not suggest a clear difference in the level 
o: disadvantagedntss betwei»n people in the broad-coverage and selective-voluntary 
programs listed in Table 4.6. On the one hand, controls in selective-voluntary programs 
were more likely to be employed than were controls in broad-coverage programs. (Based 
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On the second point, in experimental studies of selective-voluntary 
programs, random assignment is usually conducted very close to the 
start of program participation, whereas it is implemented much earlier in 
evaluations of broad-coverage, mandatory systems. As a result, the 
share of experimentals who actually participated in employment- 
directed services was much higher for the selective-voluntary than the 
broad-coverage programs (see Table 4.6). When this occurs (unless, as is 
not likely, impacts on nonparticipants are comparable to those on par- 
ticipants), average impacts per experimental may be lower for the 
broad-coverage programs, but average impacts per actual participant in 
employment and training services may be much more similar.'' 

The extraordinary accomplishment of the SWIM program for AFDC 
recipients is also underlined by comparison with the results from the 
higher-cost, selective-voluntary programs (which also targeted recipi- 
ents). As shown in Table 4.4, SWIM produced average earnings impacts 
per AFDC recipient of $889 in year 2- comparable to the impacts for the 
smaller, selective-voluntary programs - even though its impacts were 
averaged across the full spectrum of mandatory recipients and included 



on thf List quarter of follow-up available in year 2, the employment rate for controls in 
broad-coverage programs ranged from 1 3.8 percent in West Virginia to M 1 percent in San 
Diegi) 1; m selective-voluntary programs, it ranged from 42.3 percent in Supported Work 
to 57.8 percent in New Jersey.) 

On the other hand, controls in selivtive-voluntary programs were more likely to be 
on welfare. (Based on the last quarter of follow-up available in year 2, the proportion 
of controls m broad-coverage programs who were receiving welfare ranged from 36 2 
perconl in San Diego 1 to 72.7 percent in Illinois; in selective-voluntary programs it ranged 
from 47.5 percent in New Jersey to 73.5 percent in Supported Work.) 

For consistency throughout this synthesis, nli imp.icts are shown "per experimental " 
not "per participant." An example may be useful in illustrating the impact of this distinc- 
tion across the two types of studies. If we make the extreme assumption that there were tio 

impadson nonparticipants in broad-coverageprograms, then thetypicalparticipationrate 
of 50 percent would imply that the impact per participant would be twite the impact per 
lotperimcntal. (This is because the impact per experimental is the average of the impact for 
Ihenonparticipating half of the sample, who are assumed to have zero impacts, and for the 
participatmg half, who must then have impacts twice the overall average.) Under this 
assumption, the magnitude of impact per participant for some of the broad-coverage 
programs in Table 4.6 would bequite similar to the impacts per participant for Maineand 
the Homemaker-Home Health Aide IX-monstrations. 

Since it is probable that this assumption is not accurate, i.e., that the threat or reality 
of sanctioning did have some effect on nonparticipants, the real impact of broad-coverage 
programs on participants is probably U-is than that suggested in the prior paragraph. 
However, the example points to one of the difficulties in using comparisons across the 
two types of studies to reach conclusions on the effectiveness of the different eniplov- 
nient services provided. ' 
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nonparticipants as well as participants. These gains are in the same range 
as the impacts for the four selective-voluntary programs included in 
Table 4.6, despite their higher participation rates and more intensive 
average service mix. 

swim's accomplishments may follow from the unusual combina- 
tion of providing some low- and some much higher-cost services. They 
may also^ however, follow from a number of different features of this 
demonstration: the strict enforcement of an ongoing participation re- 
quirement, the extensive prior experience of the San Diego staff, or the 
education md training services available in that county. Given the 
impressiveness of the findings, it would be particularly important to 
determine whether the results can be replicated in other locations. 

The cost and impact results for the selective-voluntary programs in 
Table 4.6 can also be used to extend the analysis in Chapter 4's section on 
"The Effect of the Program Model and Funding.'' The earlier discussion 
of the relationship between program cost and impact, which focused 
mainly on broad-coverage programs, suggested that in addition to 
average impacts, administrators may be interested in other measures of 
program effectiveness, including the impact per dollar invested. Since 
this measure adjusts for variation in cost, it is also more appropriate for 
comparisons across the different categories of studies in Table 4.6.^^ 

The general finding from the broad-coverage programs was that 
lower-cost programs tended to have smaller average impacts on earnings 
(but not always on welfare savings) than the higher-cost ones, but that 
their earnings (and somewhat less consistently their welfare) impact per 
dollar invested was often larger. The selective-voluntary demonstrations 
appear to provide a further indication of the decreasing cost-effective- 
ness of higher-cost components, using this second measure.^^This means 
that lower-cost programs would allow states both to serve more people 
and (as long as they exceeded the service threshold suggested by the 
Cook County j^tudy) to produce higher aggregate impacts (the total sum 
of impacts for all individuals exposed to a program) on earnings and, 
less consistently, on welfare savings for a given budget. 



See Friedltinder and Guerori; forthcoming, for a detailed discussion of these different 
effectivent»ss measurers. 

For example, each dollar spent producini earnings impacts of 75 cents in New Jerst»y, 47 
centsin Maine, 12cents in the Homemaker-Hom«» Health Aide Demonstrations, and 6 cents 
in Supported Work (Frii»dlander and Gueron, forthcoming). 
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Overall, the findings on selective-voluntary programs urould appear 
to confirm the discussion in Chapter 4 of both the possible trade-offs and 
the continued uncertainty. On the former, they suggest that, within any 
particular budget, administrators may have to balance the extent to 
urhich they can meet different program objectives: maximizing impacts 
per person (by providing some higher-cost services) or maximizing total 
impacts (by serving more people w\t\\ lov^er-cost, job search ser\'ices). If 
all dollars of earnings gains (regardless of urhom they went to or what 
level of earnings they represented) were valued equally, this migjiit 
suggest providing lower-cost services to a large number of people. If 
gtai.ig people into jobs with higher earnings - or possibly obtaining 
more consistent impacts for more disadvantaged recipients'^ - were 
sought, this might point to providing higher-cost services. Administra- 
tors interested in achievements in both directions may favor a 
broad-coverage program that combines low- and higher-cost compo- 
nents, carefully targeting the latter to maximize impact.^^ Such pro- 
grams could build on the approaches represented by the Baltimore and 
SWIM alternatives. 

On the second issue - the uncertainties still facing administrators 
choosing among alternative JOBS approaches - the selective-voluntary 
programs provide some added information but leave many questions 
unanswered. While they suggest that higher-cost components may in- 
crease average impacts and reach different groups of recipients, they do 
not address many of JOBS' and FSA's major innovations: e.g., the target- 
ing on (potential) long-term recipients, the strengthened focus on educa- 
tion and training, and the provision of transitional benefits. This suggests 
the importance of further studies directed at these populations and at 
specifically testing more substantial investments in increasing recipi- 
ents' human capital. 



See the section on "Findings on Subgroups nnd Targeting" later in this chapter for a 
disaission of what is known abt)ut the relative effectiveness of higher- and lower-cost 
services in assisting more disadvantaged groups. 

Friedlander and Gueron, forthcoming, observe: "Careful targeting of intensive services 
to long-term welfare groups may be a way to economize on program resources while 
increasing the rate of success for very disadvantaged program enrollees. By addressing 
skills deficits, the higher-cost services might increase the ratio of earnings gains to welfare 
reductions for the most disadvantaged while still yielding the AFOC savmgs expected for 
these groups. If these two effects can be demonstrated, higher-cost services may be 
regarded not as substitutes for job search and work experience but as sj^^^cific targeting 
devices embedded in larger programs that rely on lower-cost services to achieve broad 
coverage." 
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CETA and JTPA 

The other group of selective-voluntary programs, very different in 
nature from the demonstrations discussed in the preceding sec^'on, 
were employment and training services provided through CETA or 
JTPA programs. Unft)rtunately, there urere no large-scale random as- 
signment studies of the CETA program. A number of evaluations were 
conducted using a comparison group design to determine the impact of 
the program (and different program activities) on the earnings of adult 
women. While these studies usually found positive impacts for women, 
they did not provide a useful basis for determining the impact of specific 
CETA activities - public service employment, classroom training, or 
on-the-job training - on AFDC recipients because of the wide variation 
in estimates of those impacts and the fact that virtually none of the stud- 
ies isolated female welfare recipients (see Barnow, 1987; Burtless, 1989; 
Job Training Longitudinal Survey Research Advisory Panel, 1985)?' 
For this reason, they are not discussed further in this report. 

The ongoing random assignment field study of the Job Training 
Partnership Act (see Chapter 3) will provide reLibie estimates of the 
impact of the JTPA program in 16 sites - and of assignment to job search, 
on-the-job training, and classroom training - on its AFDC participants. 
Given JOBS' emphasis on education and training - and on coordination 
with JTPA ~ this will be particularly timely. However, as discussed in 
the following section, the study results will have to be used with caution 
inmakingestimatesof the likely effectiveness of similar services provid- 
ed through state JOBS programs. Only a very small fraction of AFtX: re- 
cipients participate in JTPA,^^ and, more importantly, these are clearly 
self- selected and program-screened volunteers. Changesin the targeting 
or scale of these activities can affect the generali/ability of these results. 

Information from Evaluations Currently 
Being Conducted 

Three evaluations of selective-voluntary programs that include 
AFDC recipients among participants are now under way: the Minority 



The onu study that did estimate impacts for AI-IX* women found earnings increases of 
$6(K) to $^X) per year (Bassi et al. 19«4). 
21 

For example, fewer than 4 percent of the WIN-mandatory controls in the C ook County 
study and 4 percent in the San Diego SWIM study partlcipnted in jlPA. 
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Female Single Parent (MFSP) Demonstration,. New York's Comprehen- 
sive Employment Opportunity Support Centers (CEOSC) program, and 
the National JTPA Study. 

The MFSP programs sei-ved minority women who averaged 28 years 
of age at baseline. Approximately 65 percent of them had children under 
6 years of age (40 percent had children under age 3). Over 70 percent of 
the sample were receiving AFDC or other public as. istance at baseline, 
and approximately 50 percent had a high school diploma or GEO. Ser- 
vices included education, employability preparation, job skills training, 
case management, child care, and other support services. The four sites 
were operated by community-based organizations rather than public 
assistance agencies.^^ At 12 months after random assignment - a time 
when some members of the program group were still "investing" by 
participating in relatively intensive and long-term program activities, 
and others had recently left th- program - one site (CET) showed 
relatively large positive impacts on employment rates, hours worked, 
wage rates, and earnings. In the remaining three sites, experimentals 

had employment and earnings similar to, or lower than, those of control?. 
All sites produced significant gains in GEO attainment. In one site, there 
were increases in welfare receipt and welfare payments in the 12-month 
results; in the other three, there were no impacts on welfare receipt and 
payments. Researchers working on this study state that the initial find- 
ings from the 30-month interviews with part of the research sample "are 
broadly similar" to the 12-monih site results. (See Gordon and Burg- 
hardt, 1990.) The 30-month and 60-month follow-up data, when avail- 
able, will provide valuable information on the trends over time, since the 
12-month period is too short to determine the full effects of this relative- 
ly long-term investment. Since the four sites in the demonstration varied 
not only in program configuration (e.g., concurrent and integrated 
education and training, or sequential), but also in client characteristics 
and labor market conditions, the results will probably provide numerous 
important hvpotheses about the source of impacts. (These findings are 
discussed lurther in the section on "Programs That Test Education 
Services," later in this chapter.) 



U^?r) llrl'nTL'^T""''^"^^''' "rKanizntions, the Q'nter fc.r Emplcymcnt Training 
(CfcT), c.peratcd MreP m sever.il lc>calion.s in northern California; CET is referred to here 
as a single Mrbr site. 
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New York's CEOSC program is designed to test the feasibility and 
impact of a comprehensive employment and training program for 
AFDC recipients with children under age 6. The CEOSC program serves 
relatively long-term recipients, with an average current spell on AFDC of 
44 months. Sixty percent of participants were never married, and more 
than 40 percent lacked a high school diploma at baseline. Operating in 
nine pilot sites since 1987, the CEOSC program allows for both a "custom- 
ized" approach to participant services and the possibility that some 
participants m y require a number of long-term education, skills train- 
ing, and support services in order to obtain stable employment. Within 
the general CEOSC program design guidelines, sites were encouraged 
to develop innovative approaches to serving the target group. Thus, 
there were important variations in the design, sequencing, and delivery 
of services, such as pre-employment, life skills, and/or motivational 
training; case management; and the emphasis on and duration of edu- 
cation services. Results of an impact evaluation in one site (Albany), 
using an experimental design and based on 24 months of follow-up, 
will be available in 1992. 

As discussed in the preceding section, the National JTPA Study 
should provide important new information on the impact of OJT and 
vocational skills training for selected AFDC recipients and subgroups of 
recipients. The direct relevance of the findings to state JOBS programs 
depends on the planned scale and targeting of JTPA activities in JOBS, 
compared to the 16 JTPA programs studied. With the JTPA system 
expected to be a major provider of OJT, job vocational skills training, and 
job placement for JOBS clients across the country, the evaluation will 
help establish the range of expected results for AFEKZ recipients referred 
to outside agencies for these services. For OJT, it is probable that the 
National JTPA Study sample will include relatively motivated and 
screened people, who face fewer barriers to participation and employ- 
ment than the typical welfare recipient; it may not include many very 
long-term or potential long-term recipients. On the other hand, since OJT 
programs usually involve substantial screening - whether they are 
operated within an employment and training services system or another 
administrative structure - the JTPA results may apply to the JOBS con- 
text fairly well. Similarly, because skills training under JOBS will 
continue to be provided by JTPA vendors in many localities, the study 
findings about this activity are of particular interest. 
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Findings on Subgroups and Targeting 

The answer to the question ''What works best for whom?'' is crucial 
to improving program performance because it allows program opera- 
tors to target different types of services to the groups that are likely to 
benefit the most from them. This can help states make the most efficient 
use of scarce resources and determine how to target higher-cost compo- 
nents. Information on subgroup impacts is particularly valuable in a 
system such as JOBS, where states may offer a diverse array of compo- 
nents within a comprehensive program based on individual assess- 
ments. Several studies have attempted to analyze the effects of a variety 
of interventions on different subgroups of the AFDC population, and a 
few used the findings to develop recommendations for targeting 
strategies to increase the cost-effectiveness of such programs. Never- 
theless, many open questions remain. The JOBS evaluation provides an 
opportunity to answer some of the open issues and to pose new 
questions, since the program is aimed at segments of the AFDC popula- 
tion that have not previously been mandated to participate, and because 
states will offer a broader - and potentially more costly - array of ser- 
vices than those typical in previous studies of broad-coverage programs. 

Findings on Subgroup Impacts 

The general finding from studies of both broad-coverage and small- 
er selective-voluntary programs is that impacts are larger for more disad- 
vantaged recipients. A more refined review, however, suggests a more 
complex picture, where the pattern of subgroup impacts varies with the 
program design and objective. 

Because studies of broad-coverage programs have used samples 
that included a cross section of program eligibles, they are particularly 
useful for identifying who within the caseload bi lefited from the pro- 
gram treatment. (This type of analysis cannot be done based on the 
samples in the selective-voluntary programs because they contained a 
much more narrow, program- and self-selected group.) As discussed in 
Chapter 4, there is quite consistent evidence from the completed studies 
of broad-coverage, mandatory welfare-to-work programs that the most 
job-ready enrollees (new welfare applicants) did not gain from partici- 
pating in these programs. Instead, individuals who were more 
welfare-dependent and had less recent work history tended to benefit 
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more from relatively lower-cost job search or employment-directed 
programs than did less dependent groups (Friedlander, 1988b). There 
may, however, be a threshold of disadvantagedness below which there 
are smaller earnings impacts. That is, the same studies show that the 
more dependent half of the caseload - on-board recipients, including 
those who had been on welfare more than two years, did not have recent 
earnings, and did not have a high school diploma - also appear to have 
attained below-average gains (see Table 4.3).^ For welfare savings, the 
same studies have not yet identified a similar threshold: The largest 
savings seemed to occur for the more disadvantaged groups, and there 
were no long-term savings from serving the most employable.^* 

The threshold for earnings impacts from broad-coverage programs 
may imply that higher-cost services are needed to raise the earnings of 
the more disadvantaged groups in the caseload. The Supported Work 
program, which targeted long-term AFDC recipients, provided the most 
consistent evidence of impacts with this population.'^ Moreover, even 
among those targeted by the program. Supported Work led to 
larger-than-a verage employment and welfare impacts for those women 
in the sample who were more disadvantaged: e.g., those who had never 
worked, had several children, were older, or had been on welfare the 
longest. A reanalysis of Supported Work and the quasi-experimental 
studies of the impact of WIN and CETA on AFDC recipients also 
suggested that welfare recipients with little or no recent work experience 



When bivariate relationships between demographic characteristics - high school diplo- 
ma status, the absence of children under age 12, the number of children, age, and ethnicity 
- and impacts were analyzed, they were inconsistent across the programs studied. 

The very limited subgroup analysis in the studies of the broad-coverage group and 
individual job search programs in Louisville indicated that there were larger employment 
and earnings impacts for the more disadvantaged groups: recipients compared to appli- 
cants; people with little or no recent work experience compared to those with recent 
employment; WIN volunteers with children under age 6 compared to WIN-mandatories 
with older children. The groups with larger earnings impacts were not, however, the same 
as the groups with the larger welfare savings. (See Wolfhagen, 1983; Goldman, 1981.) A 
subsequent, more detailed reanalysis of the Louisville studies found some evidence of a 
threshold for earnings impacts (Grossman, Maynard, and Roberts, 1985). 

^As discussed in Chapter 4, the SWIM research has not yet addressed whether that 
program's quite substantial benefits for AFEX: recipi^jiits extended to the most disadvan- 
taged subgroups. However, the magnitude of impacts for recipients suggests that they are 
unlikely to be limited only to the more employable within this group. Planned further 
analysis will be particularly important because bWIM (unlike Supported Work) was a 
broad-coverage program and the sample thus included people like those who volunteered 
tor Supported Work programs as well as people who were less motivated. 
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benefited substantially more, on average, than did those with some 
recent work experience (Grossman, Maynard, and Roberts, 1985). Sub- 
5roup analysis of the short-term impacts (one year after random assign- 
ment) of the voluntary Minority Female Single Parent Demonstration 
(Gordon and Burghardt, 1990) is also consistent with this general pattern. 
At the one service provider for which there were statistically significant 
positive impacts on earnings, employment gains were greatest for 
women with children under age 3 and for those who had received wel- 
fare in the prior year. 

Findings from the evaluation of the AFDC Homemaker-Home 
Health Aide Demonstrations show subgroup impacts that varied 
across sites. Subgroups traditionally regarded as more employable - 
women with more education or prior work experience, and those rated 
as having greater potential by intake workers - did not consistently 
experience larger (or smaller) impacts. The study did find, however, 
that welfare savings were usually larger for the women with the high- 
est welfare benefits at baseline. The same was not true, however, for 
w^omen with the longest duration on AFDC (Bell, Enns, and Orr, 1986). 

A possible exception to this pattern is the Maine OJT study, which 
found larger impacts for groups facing fewer employment barriers: 
women with one child, women who were at least 30 years old, and 
women who had completed high school. However, impacts were also 
large for women who had used welfare for more than two years 
(Cave, 1989).^^ 

A very different approach to the goal of identifying subgroups that 
benefit from welfare-to-work programs was used in two studies that 
examined program staffs perceptions of and knowledge about clients. 
In the Louisville group job search study, AFDC recipients who were 
randomly assigned to participate in job club were rated on job-readiness 
by their counselors before the job club began. These ratings were based 



Because of the very small sample, targeting, and screening for the Maine program, and 
the unusual characteristics of the Maine welfare caseload, it is hard to interpret these 
results. The authors of the study concluded that the program ha^ reached a relatively 
highly motivated group of women, who resembled displaced homemakers. This was 
because, despite an intention to focus on a more disadvantaged group of volunteers, the 
enrollment process scrwned out cases with child care or health problems, ptK)r basic 
skills, transportation difficulties, or otl »r barriers to employment (Auspos, Cave, and 
Long, 1988). Since less employable participants were not included in the study, its results 
donot tell us whether they would ha vebenefited from participationin this typeof program. 
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on the counselors' perceptions of their motivation and skills. The study 
analyzed the relationship between the ratings and subsequent in-pro- 
gram performance, defined as attending job club or dropping out, and 
as finding a job during job club. The study found that there was almost 
no relationship between the job-readiness ratings and performance in 
job club; e.g., some of those who were low-rated had regular attendance 
in job club and got jobs in the course of that activity. 

The second study went further/ examining the relationship between 
staff ratings of clients' employability and two outcomes: in-program 
performance and post-program results.^^ In the Homemaker-Home 
Health Aide Demonstrations, intake workers rated applicants' potential 
for post-program employment by collecting information on their educa- 
tion, v^^ork experience, and other personal attributes, and gave an overall 
rating of job-readiness that combined those factors and other, unmea- 
sured, factors. The study found that program staff based their overall 
ratings primarily on unmeasured factors (presumably including factors 
such as motivation). In addition, there was only a very weak relationship 
between the intake workers' information and ratings and staff members' 
subsequent assessments of participants' in-program progress. The 
study also found that the initial ratings were correlated with program 
outcomes (post-program earnings and welfare receipt); however, they 
were twt correlated with program impacts (the improvement in outcomes 
over what would have been expected in the absence of the program, as 
measured by the outcomes for similarly rated people in the control 
group). In other words, some participants who were rated low on future 
employability were helped by the program to improve their earnings 
and get off welfare, while some high-rated participants did no better 
than they would have done without the program's assistance. 

This study thus suggests that intake workers were able to select 
applicants who had good prospects for employment success, but were 
not able to identify the applicants for whom the program would have 
the greatest net impact. The study concluded that the intake workers' 
ratings were consistent with creaming, rather than with selecting par- 
ticipants so as to maximize program impact (see Bell and Orr, 1988). Both 
studies suggest that it is difficult for program staff to identify the people 
who will benefit most from a welfare-to-work program. 



This further nnalysis w.is possible bt^causu, in the Ht)momaker-Home Health Aide 
Demonstrations staff ratings wore condiicteii prior to random assignment and thus 
available for people in both the experimental and control groups. 
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Guidelines for Targeting 

Based on the subgroup results in five states with broad-coverage 
programs - four with relatively low-cost services and the mixed program 
in Baltimore - Friedlander (1988b) developed a series of general prin- 
ciples for targeting similar types of programs for adults. Programs of this 
sort tha t wa nt to maximize net impacts should not concentrate on serving 
only th? most job-ready portion of the AFEXZ caseload. To maximize net 
impacts on earnings, these programs may be well-advised to work with 
moderately dependent groups such as AFI>C applicants who have 
received welfare in the past (i.e., applicant returnees); then, if resources 
permit, services could be expanded to include longer-term recipients. To 
maximize welfare savings, it makes sense to devote increased effort to 
the more dependent groups. In general, this study advised against 
targeting too narrowly on the most dependent groups, in part because it 
is not known whether low-cost job search programs would produce the 
expected impactsifow/ythemore dependent individuals were enrolled.^" 
Friedlander concluded that the evidence from the five programs did not 
provide guidance on targeting specific components to specific sub- 
groups. Given the emphasis in the JOBS legislation on serving long-term 
recipients, his finding that this group did not always experience earn- 
ings gains from lower-cost services takes on added significance. It points 
to the importance of determining whether more intensive broad-cover- 
age programs will be able to replicate the more promising results for this 
group found from the targeted, smaller-scale demonstrations (e.g.. 
Supported Work) and suggested by SWIM. 

A somewhat different /iew was taken in an interesting earlier study. 
A reanalysis of subgroup impacts in Supported Work, the Louisville WIN 
Labs, WIN, and the Employment Opportunity Pilot Project (EOPP) 
(Grossman, Maynard, and Roberts, 1985) offered recommendations for 
targeting job search and employment and training services. Based on the 
initial results from their subgroup analysis, Grossman, Maynard, and 
Roberts concluded that there is very little direct evidence that alternative 
program targeting strategies would be expected to have substantially 
larger earnings impacts for either job search assistance or subsidized 
employment and training services. The results did suggest a number of 



For example, it is not clear ihnt a job club stTvinj^ only more disiidv«intaf;ed people 
would h.^ve the s«mie impacts as one that servtnJ a more mixc»d population, including 
people who are more likely tt) be successful in obtaining; work. 
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pot**ntial targeting strategies that might result in larger welfare savings 
fro. a more extensive services. These include targeting on high school 
dropouts without recent work experience, those \ ah no young chil- 
dren, and those who have been on welfare a relatively long time. 

Several other subgroups take on new importance because of provi- 
sions of the Family Support Act. The act mandates participation by cus- 
todial parents under age 20 who have not finished high school, regard- 
less of the age of their children, and prescribes education activities for 
this population (with some exceptions). Education may also be the 
prescribed service for adults age 20 and older who do not have a high 
school diploma and have not achieved a basic level of literacy, although, 
under certain circumstances, other services may be provided for this 
group. A few evaluations have studied the effect of voluntary services 
for subsets of this group, but there are no completed studies on man- 
datory programs for young mothers, since they were exempt from 
participation requirements. Because this group has been shown to be at 
particular risk of long-term welfare dependence (Ellwood, 1986), it will 
be especially important to get reliable evidence on the effectiveness of 
education and other services in increasing their earnings and employ- 
ment and decreasing their welfare dependence. The studies of Ohio 
LEAP and the Teenage Parent Demonstration should provide important 
information on adaptations of JOBS' learnfare provisions (discussed 
later in this chapter). 

Summary and Next Steps 

In very simplified form, this summary of the results of past research 
on subgroups and targeting may suggest the pattern of impacts out- 
lined in Table 5.4. 

In implementing their JOBS programs, states facedifficult choices on 
the use of more intensive services and the role of job search, especially in 
light of resource limits and JOBS' emphasis on such groups as long-term 
welfare recipients, for whom there are only sparse findings of positive 
program impacts. That there are only a few studies of higher-cost 
programs and services, which may be needed for this group, adds to the 
uncertainties. In this environment, further work on subgroups and 
targeting takes on critical importance. To date, only Friedlander (1988b) 
and Grossman, Maynard, and Roberts(1985) haveexamined in depth the 
impacts of a number of broad-coverage programs across different sub- 
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TABLE 5.4 SUMMARY OF RESEARCH ON THE RELATIONSHIP 
OF IMPACT TO LEVEL OF DISADVANTAGEDNESS 
AND TREATMENT 



Level of 

Di sad van tagedness 



Low- to Moderate-Cost, 

Broad-Coverage 

Programs 



Higher-Cost, Selective- 
Voluntary Programs 



Less dependent 



No consistent earn- 
ings gains or welfare 
savings 



Not tested 



Middle group 



More dependent 



Consistent earnings 
gains; no consistent 
welfare savings 



Some (but not consis- 
tent) earnings gains; 
more consistent wel- 
fare savings 



Limited number of stud- 
ies, which did not cover 
the full spectrum of the 
caseload and did not sys- 
tematica lly isolate groups 
by level of disadvan- 
tagedness. Consistent 
earnings gains; usually 
welfare savings 



groups of the caseload. Some information will be gained from further 
analysis of data from completed experiments - in particular, the planned 
further analysis of the SWIM data. Here it will be important to deter- 
mine: What SWIM services were provided to which subgroups? Were 
the impacts of SWIM uniform across subgroups of recipients? Did 
SWIM benefit the most disadvantaged groups of recipients? The answers 
to these questions will help target intensive services on persons who 
will benefit from them. 

The discussion in this synthesis suggests that JOBS ^ministrators 
may face a trade-off in trying to meet different program objectives: 
increasing the earnings of particular groups and maximizing welfare 
savings. But the nature of this trade-off is uncertain. It will remain so 
until further studies examine the potential of the intensive services 
that most states will hv using under JOBS - particularly education and 
training - to increase the self-sufficiency of the least employable welfare 
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recipients. This research may identify ways that intensive services can be 
carefully targeted at very disadvantaged participants to both produce 
greater earnings gains and generate welfare savings. If such service and 
targeting strategies exist, programs could reduce the need to trade off 
success in meeting different program goals. 

Programs That Test Education Services 

The basic argument for including education services in welfare 
programs is simple: If welfare recipients can acquire the knowledge and 
skills needed to get better jobs, that will simultaneously reduce poverty 
and welfare receipt. An extensive body of human capital research links 
educational attainment with earnings (Mincer, 1989). Moreover, evi- 
dence that the majority of 19- to 23-year-old welfare recipients scored in 
the bottom fifth of all people tneir age on the Armed Forces Qualifying 
Test (Berlin and Sum, 1988) and that 60 percent of California's welfare 
caseload were determined to lack either the basic educational achieve- 
ment or high school level credentials judged needed for successful 
employment (Riccioet al., 1989) demonstrates that the lack of education 
is a severe problem for many welfare recipients.^ 

Recognizing ihat long-term welfare recipients typically have much 
lower levels of education than successful labor market participants, pol- 
icymakers have reasoned that an increase in education might increase 
this group's employability. However, virtually all human capital studies 
have been based on data for people who voluntarily decided to acquire 
additional education. Much of the JOBS population will be under a 
mandate to attend an education program. Moreover, many of them will 
have previously had negative experiences in school, including school 
failure and dropping out. It is possible that some members of this 
population will lack the motivation, confidence, and school-relevant 
skills possessed by the subjects of existing human capital studies. It is 
cWso possible that the mandatory JOBS population will be less likely than 
others to select the education program that is the most economically 
promising one for their needs and goals. Education research has also 
suggested that the previous schooling received by poor and inner-city 



Thu \\n\\W\\ human capital iif wuUaru rivipit'iUs is rt'fkvtfd in studitH> showing that the 
majority i)f woniun on wclfaru, uvcn if thuy work full timo, are not likfl v to uarn moru than 
thuyreceiVL4romAFlXAK,pt^^cinI!yinhi);h-bcnofitstatt«^ 
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adults (ages 21 to 25) may be of low quality.^ If participants in the states' 
JOBS programs receive low-quality educarioa they may not obtain the 
human capital, and thus not receive the employment payoffs, that have 
been found in previous studies. 

Because of these possibilities, additional education may not pro- 
duce improved labor market outcomes for many JOBS participants. The 
hypothesis that additional education helps welfare recipients leave 
welfare and become independent is currently awaiting empirical evi- 
dence. A review of the research literature indicates that there is currently 
little solid evidence that education programs for adult welfare recipi- 
ents can improve their educational attainment or achievement. In fact, 
there is little education research of any kind on the adult JOBS popula- 
tion, on mandatory education programs for adults, oi on therelationship 
between mandatory participation in adult education and subsequent 
employment success. 

Some insights have come from the Baltimore and SWIM studies 
and from several selective-voluntary programs: the Minority Female 
Single Parent Demonstration (which included AFIX adults), the Na- 
tional JTPA Study, the SIME/DIME Manpower Experiment, the Job 
Corps Computer-Assisted Instruction Evaluation, and JOBSTART 
(which is discussed in detail in the following section). More evidence 
will come from the GAIN evaluation, which will provide the first 
rigorous impact data on labor force participation, educational attain- 
ment, and educational achievement for a broad-coverage program that 
targets many participants for mandatory education combined with other 
services. The evaluation of Florida's Project Independence, which 
began in 1990, will provide labor force impact data for a program pro- 
viding education for recipients who are determined not to be job- 
ready and whose employability plan includes education. It should be 
noted that states' JOBS programs will provide education in a wide 
variety of forms, and this may lead to considerable variation in the mea- 
sured impacts of educational activities in current evaluations. 

Except for the GAIN evaluation, none of the current studies of 
JOBS-like programs for adults will capture educational achievement 



"Nearly 5{) percent of young iidults with 12 or fewer years of schtniling who had N AEI' 
INalional Assessment of Hducational Trogrtss] reading scores in thebottomquartileof the 
distribution were members of poor or near pinir households" ( Venezky, Kat^tle, and Sum, 
1987, p. 39; see also Kirsch and Jungeblut, 1986). 
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impacts. Educational achievement refers to individuals' performance on 
standardized tests of reading and mathematics. Such data are useful 
because they provide a common metric for measuring the skills of 
individuals who live in different places, attend different schools, and 
seek work in different labor markets. In contrast, information on indi- 
viduals' educational attainment (i.e., the years of schooling and degrees 
they have received) may conceal wide variation in the quality of educa- 
tion that was received and in the skills that were actually learned. The 
results of the GAIN study of literacy impacts, which will use an 
achievement test, will provide the first rigorous information on the 
educational gains that result from JOBS. However, the complexity of the 
links between education and subsequent employment mean that data 
from several field experiments will be required in order for analysts to 
capture the effect of differing education systems within welfare-to-work 
programs and to understand how lengthy investments in education by 
welfare recipients affect their employment. 

Four selective-voluntary studies that examine education are also 
relevant to jOBS.^^ The Manpower Experiment in the SIME/DIME 
(Seattle and Denver) negative income tax experiments offered vouchers 
for education and training to participants. For low-income female heads 
of families who were not previously enrolled in school and who received 
a 100 percent education and training subsidy, participation in educa- 
tion increased, particularly among those 16 to 25 years old. Participants 
in that age group attended an education activity for an average of one 
community college quarter, compared to less than .03 quarters for the 
control group (Hall, 1980). However, there was no consistent pattern of 
impacts on earnings and employment for single female heads of fami- 
lies, and other groups showed some negative impacts on earnings and 
employment (SRI International, 1983). 

The Minority Female Single Parent (MFSP) Demonstration provided 
a mixture of relatively intensive education and training to volunteering 
black and Hispanic adults (72 percent of whom were receiving welfare) 
in four different community-based programs. (The programs differed in 
the other services they provided, including counseling, job placement 
assistance, and child care.) Available results from this random assign- 
ment study are limited to the 12 months after enrollment in the demonstra- 
tion, a period during which program participants are forgoing opportu- 

The following stvtion, on "Youth-Oricntcti St»rvicvs/' discusses studies of prognims for 
youn^ AFIX* mothers that also include educntion components. 
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nilies to work and "investing" in education and training in anticipa- 
tion of future returns, while controls are building human capital through 
their experience in the labor market. As the increase in impacts between 
years 1 and 3 in Baltimore suggests, this 12-month period is still too soon 
to determine which form of investment will yield greater ultimate 
returns. (The researchers involved in the study note that initial results 
from a longer, 30-month follow-up for part of the research sample "are 
broadly similar to the impacts at 12 months after enrollment" [Gordon 
and Burghardt, 1990, p. 104].) 

Results for months 9 through 12 after random assignment show that 
experimentals have pulled roughly even with controls' employment and 
earnings at three of the MFSP sites, and moved ahead to show relatively 
large, positive impacts on employment, wage rates, and earnings at the 
fourth site, the Center for Employment Training (CET) (Gordon and 
Burghardt, 1990). At CET in San Jose and other locations around San 
Francisco, during this fourth quarter, the average monthly employment 
rale was 9.9 percentage points higher for experimentals than for those 
in the control group, and average monthly earnings were $133 higher. 
During the same period, CET experimentals also worked an average of 
16.6 more hours per month and received an average hourly wage that 
was 72 cents higher than that for controls. (All differences were statisti- 
cally significant.) The CET earnings impacts, if they continue, compare 
favorably to those for the selective-voluntary programs shown in Table 
4.6. There were no impacts on public assistance receipt or payments at 
three of the four sites (including CET); one site showed increases in 
these. Finally, all of the sites produced statistically significant gains 
in GED attainment.^^ 



In compiirinj; these results with those from brond-CDvera^e progmmsy it is important to 
remember the cautions listL»d in Chapter 2, particularly the high participation rate in CHT 
(H4 percent) compared to those* in most broad-coverage studies. As explained in Chapter 
2, two employment or training approaches may have identical impacts on people who 
actually receive sm'/crs, but show different average impacts b<?cause participation ratios 
differed. The study with lower participation rates will probably show lower average 
impacts because it includes more people who do not receive services and whose behavior 
is not greatly aftei tt^d by the program's servicers or mandates. 

Thus the average employment impacts for CET and most of the selective-voluntary 
programs presented in Table 4.6 were substantially larger than those for ixm t of the 
broad coverage programs. As noted elsewhere, SWIM is surprising in having had impacts 
of the same magnitudeas the selective-voluntary pmgrams. (For example, SWIM and CKT 
had similar impacts on employment ratios. SWIM increased the employment rate for AFrX 
recipients - the SWIM group most comparable to the CET group - by 9.4 percentage points 
in the last quarter of the first year compared to the control group [see Table 4.4].) 
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The services provided by the four MFSP sites differed. CET provided 
job skills training to most participants regardless of their educational 
skills, supplemented by remedial education that was often incorporated 
into the training, i.e., a concurrent and integrated approach. In contrast, 
the other three sites placed less emphasis on up-front vocational train- 
ingandmoreon education and "general employability training" intended 
to improve participants' motivation, decision-making, and orientation 
toward employment so that they could gain access to further training or 
work (a sequential approach). It may be that the emphasis on up-front 
job skills training at CET helped welfare recipients make a more rapid 
entry into the labor force, while improvements in education and general 
work-readiness may have a more gradual effect on participants' labor 
market success. Perhaps a greater emphasis on employment as the 
objective of education helped focus the education services at CET. How- 
ever, it is also possible that the marked differences between CET and 
other MFSP sites (e.g., in participants' disadvantagedness, labor market 
conditions, CET's prior experience with the program approach it oper- 
ated during the demonstration, the quality of the services provided, 
CET's linkages to employers, and the availability of on-site child care at 
CET) may account for the differences between the measured impacts. In 
grappling with these and other alternative explanations, the researchers 
note: "It is impossible to isolate the effects of the many factors that we 
have identified. Short-term findings in a single site simply do not sup- 
port strong general conclusions" (Gordon and Burghardt, 1990, p. 106). 
Obviously, the long-term follow-up data on the MFSP Demonstration 
will be particularly critical. These may alter the initial picture of site 
impacts, and also provide information on the time path of impacts 
from education investments.^* 

The Baltimore and SWIM studies also suggest some caution in reach- 
ing conclusions on what factors explain the limited results at three of the 
MFSP sites. Both of these broad-coverage programs sent substantial 
numbers of participants to education and training which, in general, was 
sequential. For example, in San Diego, the community college system 
did not provide any concurrent programs integrating education with 
training, except for a small amount of English as a Second Language that 



Tindiny^s from the JOBSTART Homonstr 'tion will provide further ^uidanco on these 
issues, since the 13 sites in that project nlso tested different arrangements for sequential 
and concurrent education and training. 
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and unpaid work experience first, some participants were later referred 
to education or training, after an assessment. (In addition, registrants 
who were already participating in qualifying education programs at the 
time of registration were allowed to continue in lieu of other activity.) 
Participation in community college programs (including adult basic 
education and continuing education as well as training) was about 7 
percentage points higher (representing a 32 percent increase) for SWIM 
participants than for the control group for both AFDC and AFDC-UP 
participants. These results indicate that in a program that used up-front 
job search and work experience to remove job-ready recipients from the 
welfare rolls a substantial number of those who did not find jobs 
participated in education (Hamilton and Friedlander, 1989). 

While the lack of research on a range of JOBS-like education pro- 
grams for adults mal* is it difficult to discuss the effectiveness of partic- 
ular education strategies for this population, a recent study of a 
selective- voluntary program targeted on youth is suggestive. The Job 
Corps Computer-Assisted Instruction Evaluation (Shugoll Researrh et 
al., 1989), which targeted a young, disadvantaged population, includ- 
ing many from AFDC-receiving families, found no impacts of com- 
puter-assisted instruction on educational achievement or GED at- 
tainment compared to the levels attained by those receiving regular 
classroom instruction.^ In this experiment, there was great variation 
within and between sites in the implementation of the computer-assisted 
instruction. This finding for a JOBS-relevant population parallels the 
literature on implementation in elementary and secondary education, 
which shows that prescribed instructional methods are carried out dif- 
ferently in different classrooms and schools (Berman and McLaughlin, 
1978). The implication of these findings for JOBS education programs 
may be that programs attempting to prescribe particular education 
techniques thought to be more effective than others are subject 
to considerable implementation variation that may change the pro- 
gram model. 

Youth-Oriented Services 

The JOBS program places a priority on serving welfare recipients 
who aie at risk of long-term welfare receipt, including young mothers 
who have not completed high school The rationale for focusing on this 
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group is clear: If program services can prevent young women on AFDC 
from dropping out of school (or encourage their return to education 
programs) and establish them in the labor force, they will not experience 
the extended period of receipt and the related poverty and costs to the 
welfare system that have been associated with teen parenting (EUwood, 
1986). The states' JOBS programs may represent a substantial shift from 
previous programs in their emphasis on serving these groups. 

This preventive approach for teen parents on welfare is newer and 
less tested than the welfare-to-work methods that have been tried and 
evaluated for adults. For the teen parent population, direct job search 
and job club are often less appropriate than school-based programs, and 
thus job search is not used as a screen for more expensive services. The 
literature on dropout prevention and recovery does not provide clear 
guidance on services or likely impacts (although it can identify likely 
dropouts fairly well). Moreover, this literature does not consider man- 
datory programs with sanctions. While alternative high schools provide 
a promising approach to the problem of dropout prevention, this inno- 
vation has not been subjected to a rigorous impact study. In general, 
rigorous methods have rarely been used to evaluate dropout preven- 
tion programs (U.S. General Accounting Office, 1986; U.S. General 
Accounting Office, 1987a). 

There have been no broad-coverage welfare-to-work programs 
aimed at preventing long-term welfare receipt among young AFLXZ re- 
cipients until very recently, in Ohio LEAP, the Teenage Parent Demon- 
stration, and Wisconsin's Learnfare (Wisconsin's Learnfare is not being 
evaluated using an experimental design.) 

The evaluation of Ohio LEAP will provide impact data on the 
educational attainment, school attendance, earnings, repeat pregnan- 
cies, and welfare receipt of teen parents under age 19 who are required 
toattend school and aresubjected tofinancial rewards or penalties based 
on their compliance with the attendance requirement. These financial 
incentives are part of the monthly welfare check received by teen par- 
ents (or the adult case heads). LEAP also provides case management, 
child care, and guaranteed summer jobs. The results of this evaluation 
will inform policy choices on the design of learnfare models for prevent- 
ing dropping out of school and for returning dropouts to school. How- 
ever, it should be noted that other states are using or considering 
learnfare models that use only financial sanctions (and not financial 
rewards) as their primary incentive for school attendance; these models 
are not currently being evaluated using rigorous research designs. 
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The U.S. Department of Health and Human Services' current Teen- 
age Parent Demonstration uses an experimental design to evaluate the 
effects of education and other services, and of a continuous participation 
requirement. Participation is mandatory for a research sample of teen 
parents on AFDC in Chicago, Illinois, and Camden and Newark, New 
Jersey, who have one child when they enter the study, and also, in 
Chicago, for AFDC recipients in the third trimester of pregnancy. The 
participation requirement includes required school attendance for 
young teens and brokered or on-site education or training for older 
teens. Program services are not limited to education, as in some leam- 
fare programs, but also include counseling, parenting instruction, life 
skills instruction, and other services. The impact evaluation will pro- 
vide two-year follow-up data on educational attainment and achieve- 
ment (i.e., test scores measuring basic skills). 

The Teenage Parent Demonstration will produce important find- 
ings on the impact of mandatory education and other services on teen 
AFDC recipients. The demonstration's use of some on-site education, 
case management, and other services may create, in effect, an enriched 
education component, going beyond what is offered by mainstream high 
school and learnfare programs. The Teenage Parent Demonstration 
represents a significant model aimed at improving on the discourag- 
ing record of dropout prevention and repeat pregnancy prevention 
programs. In addition, it may be possible to use this data set to analyze 
links between educational achievement and labor market success. 

In addition to the Ohio LEAP evaluation and the Teenage Parent 
Demonstration, there are several selective-voluntary demonstration 
projects that include samples of young AFDC recipients. Two of these 
studies. Project Redirection and the Job Corps evaluation, used a com- 
parison group research design. They are included in this report because 
they served important populations, because random assignment studies 
are not available for these populations and services, and because these 
studies were conducted with considerable effort to identify and com- 
pensate for the limitations of the research design. The other two evalua- 
tions discussed, JOBSTART and New Chance, use random assignment 
research designs. 

Project Redirection was a four-site, voluntary demonstration for 
AFDC-eligible mothers under age 18, using comprehensive after-school 
services intended to prevent dropping out, teach parenting and life 
management skills, and enhance employability. It produced greater 
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short-term retention in high school, but no long-term differences in 
educational attainment between experimentals and the comparison 
group. In this case, program activities alone were not enough to increase 
high school or GED completion. However, measured five years after 
program entry. Project Redirection's impacts included an increase of 
$39 in weekly earnings and a decrease of 12 percentage points in wel- 
fare receipt for young women on AFDC at baseline. In addition. Redirec- 
tion participants showed improved child development impacts, 
relative to the comparison group. It should also be noted that Redirec- 
tion participants showed increased childbearing, again relative to the 
comparison group (See Table 5.5.) Taken together, these findings 
suggest not only that the effects of Project Redirection were long- 
lasting, but also that programs serving a teen population may not 
show their impacts on employment until participants' children are no 
longer infants and toddlers. Evaluations that use long-term follow-up 
appear to be especially important for programs focused on teen parents 
(Polit, Quint, and Riccio, 1988). 

The evaluations of the Job Corps (which serves a population of 
volunteers including both AFDC recipients and others) found that 42 
percent of Job Corps females with children completed a GED or got a 
high school diploma versus6percentofthecomparisongroup. However, 
the Jobs Corps had consistently lower employment and earnings im- 
pacts for females with children than for males or females without 
children. The Job Corps experience shows that a residential, high-cost, 
high-intensity intervention can increase the education, and to some 
extent the employment and earnings, of a young disadvantaged popu- 
lation similar to the young AFDC population (Mallar et al., 1982). 

In JOBSTART, a 13-site, voluntary-participation model aimed at 
disadvantaged youth 17 to 21 years old (and including substantial 
numbers of young mothers on AFDC), initial impact research results 
have been obtained for the 12 months following participants' applica- 
tion to the program. These results show that a GED or high school diplo- 
ma was attai ned by 27.5 percent of the treatment group versus 9.9 percent 
of the control group; for females living with their children, the respective 
figures are 33.1 percent of the treatment group versus 6.4 percent of the 
control group. Moreover, a pre-post reading test for a subsample of 
participants showed average reading gains of .7 grade levels from a 
starting point of approximately seventh-grade level. GED receipt was 
closely linked to participants' prior basic skills levels. Of treatment group 
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TABLE 5*5 SELECTED FIVE-YEAR IMPACTS OF PROJECT REDIRECTION 
FOR WOMEN WHO WERE RECEIVING 
AFDC BENEFITS AT BASELINE 



Outcome 



Project 

Redirection 

Group 



Comparison 
Group 



Difference 



Percent with a Diploma/ 

GED Certificate 
Percent Employed 
Mean Weekly Hours Worked 
Mean Weekly Earnings 
Mean Number of Weeks 

Worked during 

Previous 12 Months 
Percent Receiving AFDC Benefits 
Percent Receiving AFDC Benefits at 

Any Point in Previous 12 Months 
Mean Number of Pregnancies 
Mean Number of Live Births 
Mean Home Environment Score 
Percent Who Had Enrolled Child in 

Head Start 
Child's Mean Vocabulary Score 



47 
34 
13 
$76 



16 
54 

57 
3.2 
2.3 

44 

5() 
87 



43 
24 
8 

$37 



11 

66 

71 
3,2 
2.1 

39 

34 
82 



4 
10 
5** 
$39** 



5** 
-12* 

-14** 
0.0 
0.2* 
5*** 

16** 
5** 



SOURCE: Adapted from Polit, Quint, and Riccio, 1988. 

NOTES: The impacts are based on analyses of women in the five-year subsample who had been 
receiving AFDC benefits at baseline (193 young iTiOthers). 

*Denotes statistical significance at the 10 percent level; ** at the 5 percent level; and *** at the 1 
percent level. The figures shown have been statistically adjusted tor important baselinecharacteristics. 



O 22« 



OTHER tVALUATIONS RELEVANT TO lOBS 

229 

members entering with ninth-grade reading skills, 66 percent received a 
GED versus 43 percent of entrants who read at the seventh- or e.ghth- 

grade eveland20percentofentrantswhoreadbelowtheseventh- rade 
evel. In addition sites that emphasized the GED, used frequent practice 
tests, and offered financial incentives for passing the GED had higher 
GED attainment than other sites. It will be important to wait for later fol- 
ow-up data on the employment and earnings of experimentals and con- 
trols togaugetheeffectofeducationand training on labor marketsuccess 
A potentially significant finding of the JOBSTART Demonstration is 
that sites that provided concurrent education and training had higher 
rates of participation in training activities than sites using a sequential 
program m which education preceded training. Concurrent programs 
apparently reduced the likelihood that participants would leave thepro- 

vorhh' ir'"' P"^""'^ ^"'"'"8 component. For some 
youth,beingabletoreceiveamixtureofeducationandiob-relevanttrain- 
ing may increase motivation. At the same time, sequential programs in 
which up-front education preceded training resulted in parHcipants 
receiving a considerably higher number of hours of education than did 
youth in the concurrent education and training sites, perhaps because of 

thetimingoftlK.educationactivities.OneotherpossiblereaLforgreat- 
er education hours in sequential sites was that many youth recruited at 
these sites were more interested in attaining a GED than in receiving 

from JOBSTART will provide an opportunity to see whether, for a 
group of young AFDC mothers, these variations in seivice receipt and 
program structure translate into differences in impacts. (This will be 
particulariy important, given the diverse results from the four sites in the 
Minority Female Single Parent Demonstration.) 

New Chance is a 1 6-site national demonstration providing compre- 
hensive education and training, and employability, life management 
and parenting instruction to young mothers who are 17- to 21-year-old 
high school dropouts on AFDC. Its experimental design evaluation will 
provide impact data on educational attainment and achievement em- 
ployment, earnings, welfare receipt, and fertility. New Chance builds on 
the lessons^of Project Redirection and other efforts to help young, dis- 
advantaged women make the transition to work and independence This 

tZcTwT: ^"'P'^'"^^ than the 

typical high school or learnfnre population but who are appropriate 

targets for a prevention-criented approach because they are likely to 
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be long-term welfare recipients (Quint and Guy, 1989). As noted above, 
this group is one of the JOBS target groups. The results of New Chance 
will help determine v/hether an intervention can be effective for these 
young women. 

Programs That Test Support Services 

Welfare programs typically provide direct income for recipient^, 
services intended to help recipients leave welfare and enter the labor 
force, and support services. Support services may include child care 
during welfare receipt, transitional child care following the period of 
welfare receipt, medical assistance, transportation to needed services, 
family planning and life skills assistance, and /or counseling. The ratio- 
nale for support services includes the belief that they contribute to the 
ability of welfare recipients to leave welfare and become employed. 
However, there has been only a modest amount of research on the 
effectiveness of support services in contributing to reduced receipt and 
increased employment. Most of this research has focused on the labor 
market behavior of welfare recipients who receive child care services 
versus those who do not. 

Child Care 

Two cross-sectional studies of women with children have found an 
inverse relationship between child care costs and the women's labor 
force participation (Stolzenberg and Waite, 1984; Blau and Robins, 1986). 
It is reasonable to assume that some welfare recipients will not par- 
ticipate in education, training, or work unless they can obtain subsidized 
child care services, either through the welfare program or from some 
other source. It can also be assumed that the availability of transitional 
child care may affect the job retention of former welfare recipients. 
However, the impact of child care and transitional child care on parents' 
labor market behavior has not been measured. 

The most significant JOBS-related research on child care services is 
the Expanded Child Care Options (ECCO) Demonstration that began in 
1 990 in New Jersey. A sample of welfare recipients in the state's REACH 
welfare-to-work program who have a child under age 3 will be randomly 
assigned to one of three service groups: 

• A control group, whose members will be offered in-program 
and transitional child care for a period based on the parent's 
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welfare-to-work activities^ lasting for up to one year of educa- 
tion and training and for up to one transitional year of 
post-program employment. The in-program child care will be 
paid for by the local welfare department at the level set for its 
clients (and provided at no cost to participants), and the transi- 
tional child care will be subsidized at the established, 
income-conditioned rates used by the local welfare department. 

• A group to whom post-program child care will be offered until 
the youngest child in the family enters the first grade. This group 
will receive in-program child care paid for by the local welfare 
department at the level set for itsclients (and provided at no cost 
to participants), and post-program child care subsidized at the 
established, income-conditioned rates used by the local welfare 
department. 

• A group to whom relatively expensive, high-quality, develop- 
mental child care and parenting support will be offered until the 
youngest child in the family enters first grade. The in-program 
child care will be provided at no cost to participants, and the 
transitional child care will be charged to participants at the 
income-conditioned rates used by the local welfare department 
for its standard-quality child care. Consequently, the subsidy 
level for this group will be higher than that used for the other 
^>roups to compensate for the higher quality of the care pro- 
vided. 

More than 1,800 children will be covered by these child care offers. 
FoIIow-up data on adults and children participating in the demonstra- 
tion will be collected for at least 15 years after enrollment. In addition to 
extensive data on children's outcomes, the demonstration will collect 
impact data on parents' utilization of extended transitional child care, 
and on parents' earnings, hours worked, use of training and education 
programs, and welfare receipt, This experimental study of child care 
services will provide important new information on the role of child 
care in welfare recipients' decisions to work (New Jersey Department of 
Human Services, 1989). 

In addition to ECCO, there are two state projects that plan to use 
random assignment designs to test specified transitional child care 
benefits as part of their welfare-to-work programs. North Carolina 
received a waiver of applicable federal regulations to permit a test of the 
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effects on mothers' employment (compared to the employment of mem- 
bers of a control group) of a guarantee of child care rather than care on 
a space-available basis. Texas received a waiver permitting the state to 
test the effect of offering one year of extended transitional child care and 
Medicaid eligibility to persons who become employed . When the transi- 
tional benefits provisions of the Family Support Act took effect, these 
benefits were offered to all AFIX recipients; this will affect the evalua- 
tion in ways not yet determined. If the North Carolina and Texas 
evaluations are successfully completed, they will provide useful infor- 
mation on the impact of transitional child care benefits on parents' 
employment and welfare receipt. 

In Massachusetts' ET, a voluntary program that is relevant to JOBS, 
there is evidence that for voluntary participants who became employed, 
job retention was greater for users of day care provided by centers, 
friends, and relatives than for those with no regular child care and those 
who used babysitters. (Job retention was also correlated with health in- 
surance, provided by the employer or by Massachi'setts.) This finding 
suggests that for those motivated to become employtd, regularchild care 
and health insurance are linked to job retention (Nightingale et al., 1989). 

The Abecedarian Project, a small, voluntary demonstration, also 
provides impact data regarding the effect of child care services on 
low-income teen mothers' employment. Twenty-nine low-income, teen- 
age mothers with infants were randomly assigned; the experimental 
group received free, high-quality, developmental child care from before 
the children were three months old until they began kindergarten. Other 
services, including free medical care for the experimental group chil- 
dren, were also provided. After 4 72 years, mothers in the control group 
had a greater likelihood of being on welfare, more births, and less 
education than mothers of the children who received full educational 
day care (Campbell, Breitmayer, and Ramey, 1986). 

Studies of broad-coverage welfare-to-work programs for women 
with school-age children suggest that child care was not a major obstacle 
to participation. This is probably partly a result of the programs' designs: 
Activities were often limited to several months and scheduled around 
school hours. Among program participants during the school year in 
SWIM, for example, for 33 percent of cases studied, activities usually 
occurred while the child was in school; in another 17 percent, the 
youngest child was 14 or older and cared for himself or herself; in 22 
percent of cases, a relative provided care; and in 17 percent, a non-rela- 
tive provided care, usually not in a center. Among a sample of SWIM 
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nonparlicipants, only 5 percent showed child care as the reason they 
were not active (Hamilton, 1988). 

There is much more limited evidence on programs for women with 
younger children, since WIN programs rarely required them to partici- 
pate (an exception is Arkansas). While the evaluation of California's 
GAIN program does not involve the experimental manipulation of 
child care services, it does supply information that supports the wide- 
spread belief that program-provided child care services are more impor- 
tant to mothers of young children than to mothers of school-age child ren. 
Utilization data show that for welfare recipients who participated in a 
GAIN activity, 29 percent of those with children age 6 and older received 
I timbursement from GAIN for child care, and 68 percent oi those with 
children under age 6 received reimbursement from GAIN for child care. 
Those not receiving GAIN-paid child care either participated in their 
GAIN activity while their children were in school or made child rare 
arrangements without using GAIN funds. (See Martinson and Riccio, 
1989.) The MFSP study also found heavy use of child care (including 
formal care) by women with young children (Gordon and Burghardt, 
1990). These findings suggest that in the states' JOBS programs, the 
demand for paid child care may be quite high among welfare recipients 
with children under age 6. 

Transitional Benefits 

Some analysts have argued that without transitional benefits that 
compensate for their reduced real income due to medical care costs and 
the child care services necessary to enable them to work, welfare recipi- 
ents face a strong disincentive to leave welfare for employment. There 
are no completed studies that have experimentally varied the transition- 
al benefits provided to former welfare recipients. However, prior to the 
implementation of FSA's transitional benefit provisions, several states 
obtained waivers of applicable federal regulations to permit them to 
enrich services in order to measure the effects of transitional benefits on 
employment. In Texas's experiment, there will be a comparison between 
persons offered one year of transitional child care and medical benefits in 
the pre-FSA period and those not in this enriched services group. (After 
the transitional benefits provisions of FSA took effect, all AFDC recipi- 
ents became eligible for these transitional benefits, including all AFDC 
recipients in the Texas study.) Wisconsin will test the effect of offering 
one year of extended Medicaid eligibility to persons losing AFDC eligi- 
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bility because of earnings; this experiment will also include a test of 
revising the earned-income disregard as an incentive for we! are recipi- 
ents to leave welfare. (In the experiment, reduced welfare benefits are 
provided for people entering low-wage employment.) The target group 
includes AFDC recipients with children three months of age or older. 
These experiments will provide information on whether transitional 
benefits encourage welfare recipients to become employed and retain 
their jobs. (When the transitional benefits provisions of FSA took effect, 
all persons in the experiments became eligible for them.) In addition, 
Ohio is testing a program in which the experimental group received an 
offer of transitional child care and Medicaid if they left welfare for 
employment, a mandatory pre-employment assessment, and the oppor- 
tunity to volunteer for welfare-to-work activities (although participa- 
tion in these is not required). As in the other states, the transitional 
benefits were extended to all AFDC recipients when the provisions of 
FSA took effect. The target group in Ohio is AFOC recipients who have 
children under age 6. Finally, Illinois is testing a program for former 
welfare recipients earning less than 185 percent of the standard of need. 
A randomly assigned experimental group will be offered payment for 
expenses related to training they receive while employed, including 
transportation, child care, fees other than tuition, and training materi- 
als (up to $300). This program aims to prevent welfare recidivism. 

Transportation 

No rigorous studies have experimentally varied the availability of 
transportation for participants in welfare-to-work or similar programs. 
However, surveys of WIN-mandatory welfare recipients who dropped 
out of job search programs found that approximately 5 to 10 percent 
cited transportation problems as the reason for ending their participa- 
tion. Implementation studies of welfare-to-work programs outside of 
urban areas have found that "(limited] transportation may constitute a 
formidable constraint in rural areas" (Polit and O'Hara, 1989, p. 190). 

Life Skills Instruction and Counseling 

Three voluntary demonstrations using rigorous research methods 
provide impact information suggesting the potential usefulness of life 
skills instruction and counseling provided by health care workers. 

In the Pregnancy/Early Infancy Nurse Home Visitation Program, 
400 mothers were randomly assigned to several treatments or to a con- 
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h-ol group Participantewere recruited if they were under age .9,sinKle 
or poor. Tl,e treatments involved visiting nurses who p Jided heflth 

ca«.„fa„tcare,andfamilyplanningi„fonnaHonbegilngdurinX 
mmher^s pregnancy and continuing up to three yea! after the child 
t... Nurses also pmvided counseling on returning to school or work 
Follow-up surveys found that the poor, unmarried mothers who 

quenay) had a 12-month greater interval between their first and 
second ch,ld and had twice asmanymonthsofemploymentfou years 
a,ter ,he,r child's birth than the control group (Olds et al., 1988) 

A rephcation and expansion of the Nurse Home Visitation Program 

. curren yunderwayinMemphis,Tennessee(Oldsetal.,nodate) Th^ 
study w,ll examme the impacts of nurses' home visits to poor, firs -t me 
mothers on maternal education, employment, and welfa'rrrece.p, 
I„f» . K ?u ' School-Aged Mothers and Their 

Infants, a hosp, al-based program, provided comprehensive serves 

age 3. One hundred black teen mothers revived services and were 

hospital. Those who received services had a greater rate of school 
mce and graduation, and fewer repeat pregnancies, at *e fi^ 
follow-up survey two years after the iniHal birth (Hardv et al., 1981 ) 
assiJrt Imd -ff fT"^ '"tervention Program conducted a random 
l irr C'"' '""P"'' ""''y '^tments.- a series of 

ZcCTZT"',V""'"^*""''"'^'«'^'*"°"*s,„rt 
as a CETA-paid infant care aide in a hospital infant nursery After two 

work, and fewer repeat pregnancies, than controls; these impacts were 

s°dri:tr"""'"^'"^^^^^^ 

Taken together, these demonstration studies suggest that counsel 
™trt P-^^^'^ the contSt of fn^X^; " 

z^:z:r ''''''' --'^^ — « 

Combinations of Program Models 

The review of evaluations in Chapters 4 and 5 divided the relevant 

~Z ''T °' programs, selective-vol Zy 

program., education services, etc. Because of budget constraii.s, how^ 
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ever, many states will be designing mixed programs, balancing the pres- 
sure to serve large numbers of people against the evidence that more 
intensive services may be needed to reach long-term and potential 
long-term recipients. It is probable that some states' JOBS programs will 
be broad-based, and yet draw on the approaches listed in the other cat- 
egories of this chapter for serving specific groups of welfare recipients. 
For example, a broad-coverage JOBS program that has job search as a 
first component for many people may also include a subsequent choir? 
of OJT, training, education, or other activities for those who do not be- 
come employed during the job search activity. (In some programs, par- 
ticipation in these subsequent activities may be voluntary.) In evalua- 
tions of this type of program - where different services will be provided 
for different groups of recipients - comparisons of outcomes (or impacts) 
across components may not reflect the differential effectiveness of the 
activities because of differences in the populations served. Moreover, 
the relevant issue in assessing each component is whether it pro- 
duces cost-effective impacts specifically for the targeted population, 
rather than fo! the broader caseload. This points to the complexity of 
interpreting impacts for these programs and to the continued impor- 
tance of in-depth implementation and process studies for under- 
standing the components and strategies that will comprise future 
broad-based state JOBS initiatives. 

Much can be learned about the role of higher-cost and more intensive 
services from the studies of ^elective-voluntary and broad-coverage 
programs already in place. However, new studies are needed to actually 
determine whether such services - including the kinds of education, 
training, and support service'^ provided in the selective-voluntary dem- 
onstrations - could be expanded in scale and produce greater impacts 
than the usual mix of activities in broad-coverage programs. It would be 
particularly useful to implement two types of studies. First are additional 
net impact studies of large-scale, broad-coverage programs that empha- 
size education and ot'^pr human capital development services - JOBS' 
major programmatic innovation. These would test the impact and 
cost-effectiveness of these services across the brond group in the case- 
load that is determined to need education. Second are differential 
impact evaluations specifically designed to determine the relative effec- 
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tiveness of competing approaches.^^ These could include studies of the 
relative effectiveness of: 

• High-intensity human capital investment approaches featur- 
ing education and training compared to (1) high-intensity ap- 
proaches stressing participation in the labor force, or (2) 
lower-intensity approaches featuring job search and placement, 

• Different processes to determine who receives more expensive 
services, e.g., programs that determine services based on an 
assessment versus those that have a fixed sequence starting 
with job search. 

• Mandatory versus voluntary programs. 

• Different types of assessment and case management. 



Preferably, these would involve the rnndom assignment of program eligibles to two 
treatment groups and to a control group not given access to JOBS services. 
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The preceding chapters examined the extensive studies of state 
welfare-to-work programs as well as other studies of employment and 
support services designed to help low-income people join the labor 
force. This body of work suggests both that much has been learned and 
that many key questions remain about how to structure more effective 
programs. The gaps in knowledge can be seen by comparing the key 
features of JOBS (Chapter 2) with the current and anticipated findings 
from existing researci. (Chapters 4 and 5). Viewed together, the complex 
JOBS legislation and the evaluation results from previous program mod- 
els point to the need for new information on two levels: (1) the effects of 
particular service components on specific populations, and (2) the 
effects of entire service delivery systems, which include multiple ser- 
vice components and management processes, on the broad welfare 
population and selected groups within it. JOBS calls for new services, 
new target groups, and new systems. Thus, future judgments of its effec- 
tiveness will hinge on closing these knowledge gaps and understand- 
ing the trade-offs in meeting different potential policy goals. This con- 
cluding chapter briefly discusses the most critical open questions 
about the potential of JOBS. 

I. The Return to the Investment in Education 
and Training 

Chapter 4 pointed out that most past research on broad-coverage 
initiatives focused on low- to moderate-cost programs that sought to 
place people rapidly in jobs. Even for programs judged successful and 
cost-effective, the research shows that many people continued on welfare 
and that those who left often remained poor. It also suggests that the 
lower-cost programs that provided primarily job search assistance usu- 
ally were not able to increase the earnings of the most disadvantaged. 

JOBS' emphasis on education (for those with poor basic skills) and on 
other intensive, usually higher-cost, services represents a very differ- 
ent approach - one that has not been rigorously evaluated. In theory, 
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successful education-based initiatives should increase welfare recipi- 
ents' human capital and thus their potential for getting better jobs, 
moving out of poverty, and achieving long-term economic indepen- 
dence. Existing studies clearly show that welfare recipients often have 
poor basic skills and that education is correlated with higher income. 
But, as described in Chapters 4 and 5, completed research does not 
address the question of whether large-scale education programs for 
welfare recipients can increase educational achievement, attainment, 
and income and reduce welfare receipt. This fundamental cause-and- 
effect relationship between education services and employment- 
related outcomes has not yet been demonstrated for welfare recipients. 

Among the most critical unanswered questions facing states 
designing their JOBS initiatives, then, are: Will greater investments in 
education and training services result in greater success, particularly for 
long-term recipients? Will programs emphasizing human capital devel- 
opment lead to jobs with higher wages and greater stability, to lower 
rates of job loss and welfare recidivism, to greater long-term self- 
sufficiency, and to higher incomes and reduced poverty? Will programs 
emphasizing education result in increases in literacy and quantitative 
skills? Will additional gains justify the expanded outlays? How should 
these ser\'ices be structured and targeted to be most effective? 

Complicating JOBS administrators' decisions is information on the 
effectiveness of lower- and higher-cost services. Chapters 4 and 5 sug- 
gested that they may face a trade-off in deciding how to allocate a fixed 
budget. Together, the studies of the two broad-coverage programs that 
included education and other more intensive services (Baltimore and 
SWIM) and the studies of a number of selective-voluntary higher-cost 
programs (that did not include education) provide some evidence that 
more intensive activities can lead to higher average earnings gains (but 
not necessarily higher welfare savings) than lower-cost services. How- 
ever, the lower-cost services had higher impacts on earnings and wel- 
fare savings per dollar invested. This suggests that administrators who 
focus on raising earnings above a certain minimum level - or possibly 
reaching more disadvantaged recipients - might favor higher-cost ser- 
vices, while administrators who desire to maximize total program im- 
pacts, regardless of their distribution, might decide to serve more 
people with lower-cost services. Administrators seeking to use fixed 
resources to reach both objectives might favor a broad-coverage 
program with higher- and lower-cost components, carefully targeting 
intensive activities to benefit longer-term recipients. 
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Unfortunately for JOBS administrators, the many innovations in 
FSA and the limited number and nature of past studies mean that the 
relevant parameters of this trade-off, and even its ^applicability to current 
JOBS program models, remain highly uncertain. Yet understanding the 
details of what works best for whom in the new JOBS environment is 
critical. Every state is facing a choice about the scale and intensity of JOBS 
services, given the limited resources available compared to the large 
number of potential enrollees. To structure JOBS initiatives so that the 
most appropriate services are targeted to groups in the caseload who 
can benefit from them most and to balance the pressure to serve more 
people with relatively few services against the likely return of providing 
more intensive services to a smaller share of the caseload - additional 
research is needed. 

Some of the evaluations already under way will expand our knowl- 
edge in this area. But answering these questions as definitively as central 
questions of the 1980s were answered will require two types of studies. 
First, studies will be needed of broad-coverage programs that empha- 
size education and other human capital development services for sub- 
stantial numbers of potential long-term recipients; these should include 
programs that operate across a variety of environments, administrative 
approaches, and implementation strategies. Second, studies will be 
needed that determine directly, with rigor and for key subgroups, the 
relative effectiveness of different JOBS approaches. Specifically, pro- 
grams that stress human capital investments should be compared to (1) 
lower-intensity, work-oriented approaches emphasizing more immedi- 
ate job search and placement, or (2) other work-oriented approaches that 
stress labor force participation but also include some relatively inten- 
sive services, e.g., on-the-job training or education and skills training 
closely tied to actual jobs. The most conclusive tests would be random 
assignment, differential impact studies, in which two strategies are 
implemented and compared in a single site. 

Moreover, studies that seek these answers must plan for follow* up 
data collection adequate to determine the payoff from the greater initial 
investment in education. While the short-term job search and work 
experience programs were often studied with very limited follow-up 
(and sometimes proved cost-effective within two years), the initial im- 
pacts for intensive human capital programs may not be apparent until a 
year or two after enrollment, and a final assessment of their effective- 
ness will take much longer. 
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2. The Impact and Cost-Effectiveness of Programs 
for Mothers with Young Children, Teen Parents, 
and Long-Term Recipients 

The JOBS legislation sharply reduces the population that is exempt 
from employment programs. It extends the participation requirement 
to women with children 3 years of age or older (age 1 or older at state 
option) and specifically targets resources at young mothers. It also 
requires young custodial mothers without high school diplomas to 
attend school (the learnfare provision), regardless of the age of their 
child. While some selective-voluntary programs have targeted these 
groups, there are many more questions than answers. In particular, we 
have very little evidence of whether broad-coverage programs can be 
successful or cost-effective for mothers with preschool children (especially 

inlightof this group'sgreater child careneeds).Regarding requirements 
for teen parents, two major studies are in place on variants of this 

approach. They willexaminewhether the threatofsanctions(orsanctions 
combined with financial rewards)andtheprovisionofadditionalservices 
increaseschoolattendanceandretention,and thereby increaseeducational 
attainment and employment and reduce long-term welfare receipt. We 
also have very limited information on whether still further outreach, 
supports, and services are needed to improve teen mothers' school 
attendance and eventual movement off welfare. Closing these knowl- 
edge gaps is particularly important, given the evidence that young, 
never-married mothers are the group most likely to become long-term 
welfare recipients - evidence that contributed to their being given 
priority by JOBS. There is also not a strong research record of employ- 
ment gains by the most disadvantaged recipients, heightening the im- 
portance of determining whether broad-coverage JOBS programs that 
include higher-cost components can be more successful in assisting this 
group to move from welfare to work. 

3. The Effect of Different Case Management Practices 
and Mechanisms for Determining the Nature 
and Sequencing of Services 

As suggested by Chapter 4, we know very little about the effective- 
ness of two other program dimensions highlighted by JOBS: assessment 
and case management. Both serve in part as mechanisms for determining 
who is served and what they are offered or required to do, functions that 
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are central in multi-component programs designed to serve people with 
a range of employability characteristics. These sorting and decision- 
making processes reflect implicit or explicit targeting policies that are 
key to allocating services of varying cost and intensity. Thus, the ability 
of JOBS programs to achieve substantial participation - and potentially 
convert participation into program impacts - may turn on the effective- 
ness of these activities. 

Past research on broad-coverage programs suggests that the first 
activity people participate in is crucial, for many do not go into any 
subsequent activity. Thus, it matters greatly whether a program is 
structured sequentially - with ^he order of services based on prescribed 
and uniform rules - or us an individualized assessment approach. 
While most of the broad-coverage programs evaluated to date used a 
fixed sequence starting with job search, current state JOBS programs 
often use a structured, intensive up-front assessment, followed by the 
development of an individualized employability plan and referral to 
services deemed appropriate by the case manager and /or welfare 
recipient. Case managers, in addition to helping craft the service plan, 
play a major role in its implementation, . iing to assist, encourage, 
monitor, and enforce compliance and to link people to services, par- 
ticularly in more complex, multi-agency programs. 

Given the importance of the first component to which people are 
assigned \n determining services received, and the expense of in-depth 
assessment, it would be particularly useful to understand the relative 
effectiveness of programs that determine service assignments based on 
an assessment (and that use different forms of assessment) compared to 
those that impose a fixed sequence, often starting with job search. Also, 
it would be useful to learn the relative effectiveness of different assess- 
ment approaches: those that use in-depth individual assessments; those 
that use different definitions of employability; and those that set differ- 
ent criteria for referring people to job search or for entering aud exiting 
basic education (e.g., higher or lower literacy levels). 

It would also be important to learn more about the effectiveness of 
different case management strategies. Welfare-to-work programs use a 
wide range of case management approaches. In some localities, tasks 
associated with assessing, assisting, motivating, monitoring, and broker- 
ing services for program participants have been divided between wel- 
fare agencies and other service providers and, within these agencies, 
between case managers and other staff. Alternatively, a single case 
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manager may be responsible for every aspect of participation for those 
assigned to him or her. Caseload sizes and the emphasis of case manage- 
ment activiries - e.g,, on counseling versus monitoring and enforcing 
participation - vary as well, and may affect program impacts. The sub- 
stantial share of JOBS resources that will probably be devoted to these 
activities, and the central role given this function in some state pro- 
grams, highlight the importance of further understanding the 
cost-effectiveness of different intensities of and approaches to case 
management. 

4. The Relative Effectiveness of Mandatory 
and Voluntary Programs 

As indicated in Chapter 4, some people argue that mandatory pro- 
grams are likely to have larger impacts than voluntary ones, primarily 
because they may reach people who can benefit but would not opt to 
participate on their own and because they reach more people overall. 
Deterrence and sanctioning effects can also contribute to mandatory 
programs' impacts. Others claim that voluntary programs are likely to 
be more successful because they may enroll people who are more 
predisposed to take advantage of program services and who there- 
fore attend activities more regularly, leading to higher impacts and 
saving the program "compliance costs/' 

Unfortunately, past studies do not provide clear guidance on this 
issuj. The data for the broad-coverage programs suggest no evident 
relationship between either sanctioning or participation rates - both of 
which are possible proxies for the extent to which a program was 
mandatory - and program impacts. There have been studies of broad- 
coverage mandatory and smaller voluntary programs, but there are no 
rigorous studies that directly compare - for similar people - the impact 
and cost-effectiveness of mandatory and voluntary broad-coverage 
programs, or of programs that are more or less stringent in imposing 
program requirements. 

The JOBS legislation calls for states to give first consideration to 
volunteers among the program's target groups, but it allows for a 
participation mandate for the full non-exempt caseload. In designing 
their programs, states are likely to move in different directions in 
response to the complex message of the legislation, their own poli:y 
preferences, and the absence of research guidance. This variation will be 
reflected in several program characteristics affecting mandatoriness: 
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caseload monitoring strategies, deferral and exemption rules and prac- 
tices, program "messages/' weekly hours of service, and sanctioning 
pr oced u res. As was also observed i n the 1 980s WIN and WIN Demonstra- 
tion environment, states are likely to implement programs that run the 
gamut from those that serve only volunteers to those that are mandatory 
and pay a great deal of attention to compliance. There is unlikely to be a 
clear dichotomy: Many states' programs will probably include aspects of 
both approaches. 

Critical unanswered questions about different approaches include: 
How effective are mandatory compared to voluntary programs in in- 
creasing participation and changing earnings, employment, and welfare 
receipt, particularly among more disadvantaged recipients? Will strict- 
er enforcement and sanctioning increase program impacts? Do manda- 
tory programs reach people who would not obtain jobs on their own? Do 
voluntary programs increase services to the group most able to benefit 
from them (getting them better jobs), or would this group have received 
services and left welfare for similar jobs on their own? What are the 
relative costs of operating more and less mandatory programs? 

Practices for requiring or encouraging participation will probably 
affect critical JOBS concerns: targeting, the cost of program manage- 
ment, and success in meeting JOBS' performance standards. This makes 
it particularly important tocla rify how more or less ma ndatory approach- 
es affect these issues, and how they influence program impact and 
cost-effectiveness. 

5. The Impacts of Programs for Adults 
in Two-Parent Families 

The JOBS legislation contains special provisions for the (usually 
male) principal earners in famili(»s constituting the small AFDC UP 
program. These call for involveme U primarily in work programs, with 
an option of education for young fathers who have not completed high 
school. They set eventual participation standards that are much higher 
than those for singleparents.Thedilemmaadministrators will face when 
these standards take effect in a few years is how to design programs that 
are effective and meet the standards, without targeting a disproportion- 
ate share of JOBS resources to AFDC-UP cases. Prior research is scanty 
and has not found effects for work-only models, Determining the cost- 
effectiveness of alternative approaches for this group is thus of consid- 
erable importance. 
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6. Understanding the Nature and Duration of Impacts 
on Welfare Recipients and Their Children 

Most of the research summarized in Chapters 4and 5 addressed the 
impact of welfare-to-work programs on welfare recipients' employ- 
ment, earnings, and AFDC receipt. Some studies measured effects on 
welfare recipients' income (but usually not considering household size 
or the full range of income sources, thus limiting estimates of poverty 
status), and some looked at effects on wages and job quality. Measures 
of program effects on educational achievement and on participants' 
ch.ldrenarealmosttotallylacking.JOB.S'emphasisoneducation,andthe 

lackofresearchonwhetherthistranslatesintoemploymentoutcomesfor 
welfare recipients, highlights the desirability of measuring a broader set 
of outcomes, including literacy and job quality. JOBS' extension of a 
participation mandate to women with younger children, combined with 
FSA s assurance of in-program and transitional child care, points to the 
importance of determining how the program affects participants' chil- 
dren. To address these areas, future studies should be expanded to 
include job characteristics, family formation, family income and pover- 
ty, health status (for mothers and children), educational attainment 
and achievement, family functioning and parenting, and the well-being, 
development, and achievement of the children in AFDC families. 

A related open question concerns the durability of impacts and their 
patterns over time. We kno.v that low-cost services have impacts that 
start soon after program entry and extend for at least the three years 
measured in recent studies. We have evidence that the effects of more 
intensive programs will be slower to appear but will also continue for at 
least this long. However, there is almost no evidence on longer-term 
impacts or on changes in impacts over time. For example, we do not 
know whether the impacts of low-cost job search programs will eventu- 
ally decrease, or whether the impacts of programs that make a more 
substantial investment in human capital will increase. Longer follow-up 
will be particularly critical in assessing the payoff of programs that make 
a substantial investment in education, and those targeting very youne 
mothers and their children. A longer perspective on both higher- and 
lower-cost services is also essential for determining the relative success 
of different JOBS strategies in meeting potentially competing pmgram 
goals, particularly for estimating the parameters of the trade-off 
described in Chapters 4 and 5 - between average earnings gains and 
aggregate benefits per dollar spent. 

Rjc 2(n 
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A further open question concerns the relationship between impacts 
on earnings and welfare savings. State JOBS programs will vary in their 
emphasis on increasing people's earnings or producing welfare savings, 
but most will have both as goals. The research summarized in Chapters 
4 and 5 showed that programs were sometimes not successful in meeting 
both objectives. However, it is not clear why results varied widely across 
sites that tested the same model and across different program 
approaches. In designing JOBS programs, administrators would benefit 
from more information on the relationships between program features - 
e.g., targeting strategies, service models, AFDC grant levels, sanction 
rates, and various implementation practices - and net impacts on earn- 
ings and welfare savings. Similarly, how these program features affect 
the mix of earnings gains and welfare savings achieved by a program 
would be invaluable information for JOBS policymakers. 

7. The Relationship Between Program Scale or Economic 
Conditions and Effectiveness 

Only a few of the studies summarized in Chapters 4 and 5 were of 
full-scale, broad-coverage WIN programs. Some studies were limited to 
a specific program office, county, or segment of the welfare caseload; 
others were small demonstration efforts. While it is still unclear what 
"full scale" will mean for JOBS in any given state or, within a state, for 
individual program components, the financial commitment made by 
Congress suggests that there will be su ^stantial expansion over the WIN 
program of the late 1980s. It is not certain whether the impacts from 
earlier studies can be replicated if JOBS extends services to a much 
greater share of the caseload. 

JOBS' greater scale may affect impacts in other ways. An important 
issue in all employment and training programs - one that past studies 
have found extremely difficult to address-is whetheremployment gains 
for people in the program represent net increases in job-holding or come 
at the expense of other (displaced) workers. Further, the multiple provi- 
sions in PSA mean that state JOBS programs could substantially change 
the balance of opportunity and obligation within the welfare system, 
with uncertain effects on the size of the caseload. For example, new 
obligations and messages about participation requirements could deter 
AFDC applications, but new service opportunities and more positive 
messages about program services could attract people to welfare and 
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lead them to remain longer in order to complete program activities. 
Some of these effects would not be captured in studies that measure the 
impact of the program on persons already in the welfare system, rather 
than on the broader population. 

Another unanswered question is the extent to which the effective- 
ness of JOBS - particularly when it is operated at large scale - will depend 
on local and national economic conditions. Positive evaluation results in 
sites facing a range of unemployment levels and labor market changes 
(but not confronting highly depressed conditions) suggest that these 
programs c?n have impacts in relatively strong or weak labor markets, 
and in improving or deteriorating economic conditions. However, the 
West Virginia study suggested that welfare-to-work programs may not 
succeed in rural areas with very weak labor markets. Extreme cyclical 
variations in the economy may also affect program impacts in ways that 
are currently unknown. 

8. The Feasibility and Replicability of Particular JOBS 
Approaches and Achievements 

The broad-coverage programs described in Chapters 3 and 4 were 
usually relatively straightforward to implement. They often involved 
only one oi two activities (e.g., job search and work experience), which 
could often be provided directly by the welfare agency. Even for these 
programs, however, the evaluations show great variation in implemen- 
tation strategies and success. The JOBS legislation requires states to 
design more complex programs involving more activities and extensive 
C(X)rdination among many delivery systems, including JTPA, teen and 
adult education programs, community colleges, child care agencies, and 
the welfare system. JOBS also requires states to report on their success 
in meeting the new and complex participation standards and in serving 
the JOBS "target groups." These changes may be difficult for states to 
implement, and they suggest the need for research on the feasibility of 
different responses to these design and implementation requirements. 

There is no body of information available to guide states in making 
decisions about the structure and implementation of JOBS approaches 
that is similar to the extensive implementation research on the simpler 
broad-coverage programs. As noted above, it will be particularly impor- 
tant to understand how assessment and case management practices are 
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implemented. In addition, it will be valuable to know whether the results 
of individual program models, previously tested in only one site, can be 
repeated under different conditions: e.g., in states with higher or lower 
grant levels, different administrative experience, or dissimilar service 
delivery structures; under the new work incentives created by the Family 
Support Act; in states with different economic conditions; or where the 
welfare caseload includes large numbers of people with different 
characteristics than those previously studied. Most relevant to JOBS 
administrators will be new tests, under different conditions, of models 
resembling San Diego's SWIM program and Baltimore's Options, with 
their different but promising impact results. 

9. The Development of Standards to Manage 
and Motivate the System 

During the 1980s, state WIN and WIN Demonstration programs 
were implemented in a highly decentralized environment, without a 
clear system ol' structured federal rewards or penalties. JOBS offers states 
new resources but also demands new accountability - prominently, 
through performance standards that link enhanced funding to program 
participation rates and expenditures on specified target groups. The 
legislation also calls for the eventual establishment of outcome-based 
performance standards. Tne history of the WIN and JTPA programs 
suggests both the power of focusing staff on performance outcomes and 
the importance of doing so in a way that supports program goals. The 
subgroup research summarized in Chapter 4 implies that outcome- 
based standards in JOBS must be carefully designed if they are to pro- 
mote cost-effective programming and direct the system toward making 
the greatest long-term difference in the lives of welfare recipients. More 
research, acro.ss a broader spectrum of the welfare population and 
program approaches, will be important to refining the lessons from this 
initial work and determining the feasibility and effectiveness of 
alternative approaches. 

10. The Feasibility, Impact, and Cost-Effectiveness 
of Support Services and Transitional Benefits 

There are no completed studies that measure Ihe impact of subsi- 
dized child care on participation in welfare-to-work activities and on 
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subsequent employment. Moreover, as JOBS broadens the traditional 
target groups to include young mothers participating in alternative 
education programsand leamfare programs, the current lack of informa- 
tion on the effects of subsidized child care for this group will become 
increasingly important. More research is needed to determine the feasi- 
bility, impact, and cost-effectiveness of a range of child care services and 
subsidy levels for various target groups in JOBS. 

The outcome of states' JOBS programs may also be influenced by 
FSA's provision that one year of child care and Medicaid are to be 
offrjred to welfare recipients who leave welfare to work. Questions 
about transitional benefits include: Do they provide an effective incen- 
t! /e for people to enter employment? Do they increase job stabilit)^ and 
retention and reduce the rate at which people return to welfare? What 
is the take-up rate for these services.-" Do they boost the impacts of either 
low-cost "tabor market attachment" (i.e., job search) or higher-cost 
"human capital investment" program models, or both? Do they change 
the relative cost-effectiveness of different JOBS approaches, e.g., of 
programs that tend to place people in lower- or higher-wage jobs? 
(This change could occur because, in contrast to the past, when any job 
that made a family ineligible for welfare reduced government out- 
lays, under FSA people may work and receive transitional benefits 
th jt can be more costly than cash welfare.) 



* * * * » 



The JOBS program is being implemented in an unusual research 
context. There is a large body of rigorous studies that confirm that 
welfare-to-work programs produce positive impacts and represent a 
cost-effective investment of public funds. However, many state JOBS 
mitiatives represent major departures from the programs that were 
tested earlier - in the complexity and nature of the services offered, in 
their scale of implementation, and in the groups of welfare recipients 
they target. The kev qi-esiion for such programs in the 1990s is thus not 
whether to implemei: hem, but hoiv to design them to be most effective. 
This necessitates moving from the relatively simple threshold questions 
of the earlier studies to the more complex issues noted in this chapter. 

Some of these questions will be addressed in studies and demonstra- 
Hons already in place. But others will require additional - and some- 



JO 



FROM WELFAHfi TO WORK 



ERIC 



times more refined -designs. Choices will be required, since evaluations^ 
no matter how comprehensive, cannot address all of these questions in 
equal detail; moreover, some of them go beyond what research can 
confidently determine.^ This suggests that new projects should build on 
one of the lessons from the studies of the 1980s: It is better to answer a 
few critical questions definitively than many questions partially. 
Strategic evaluation choices, strong research designs, and the active 
involvement and cooperation of program administrators and staff in 
the sites where the research is implemented will be critical in moving 
from the many remaining questions for JOBS to some clear answers. 



The JOBS evaluation, funded by the U.S. rX»pnrtmi»nt of Health and Human Services 
(HHS), is being structured to pr ^'ide information relevant to the open questions described 
under headings 1, 2, 5, 6, 8, an j 9 above, and partial information on the questions under 
headings 3, 4, and - to a lesser extent - 7. 
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Program Costs^ 



Defining and estimating the costs of the programs discussed in this book 
is complicated. This appendix describes four ways of defining program 
costs and presents alternative cost estimates for the primary completed 
studies of welfare-to-work programs considered in Chapters 3 through 5. 

Direct Costs 

Direct program costs are those incurred by the agency (or aj;encies) 
responsible for administering the program under study. They include the 
agency's own expenditures on program services and administration as 
well as the expenses of other agencies that, under formal agreements 
with the administering agency, deliver services that are part of the 
program treatn^ent.^The total expenditures incurred by these agencie^^ in 
providing a program treatment to members of an experimental group in 
a program evaluation constitute the ^rass direct cost of the program. 

Expenses may also be incurred by the administering agency in 
working with members of the control group. For example, control group 
members in the Baltimore evaluation went through program assessment 
and orientation and received counseling from WIN staff. Subtracting 
such expenditures from the gross direct cost leaves the net direct cost of 
the program - i.e., the cost of providing the program treatment to 
experimentals beyond the cost of services provided to the control group. 

Indirect Costs 

A program may have two types of effects on the expenditures of other 
programs. One is a complementary effect in which the use of other 



This appendix was writtun by David Long. 

For the progmms covered by this appendix, these agreements were always contracts. 
However, in other cases, interagency agrt^ements may give an administering agency con- 
trol over specified funds: e.g., in California, part of the state's JTPA Title IIA funding is used 
this way tor the GAIN program (see Wallace and Long, 1987, Chapter 2). 
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programs is increased by the program under study - e.g., indirect costs 
are incurred for the experimental group. This effect may arise from 
program staff's referral of individuals to outside programs, including 
situations in which individuals are systematically referred to education 
and training activities in other agencies.^ It may also reflect increased 
self-initiated individual use of these other programs owing to the con- 
tent of the program treatment (e.g., a program treatment that stresses 
basic skills preparation may cause more welfare recipients to seek 
vocational training for which such preparation is a prerequisite). 

The other potential effect is substitution. Because individuals are en- 
rolled in the program under study, they are not as free to participate in 
other programs, decreasing the use of those other programs. This effect 
results in lower indirect expenditures by these programs on members of 
theexperimentalgroup(measuredasexpenditureson thecontrol group). 

In order to get a full picture of the total program resource use gen- 
erated by a welfare-to-work program, both direct and indirect expendi- 
turesshould betaken intoaccount. Thus, the^ross directand indirect cost 
of a program includes all expenses incurred for the experimental group 
- not only the direct expenses related to providing the program treat- 
ment, but also the complementary expenses incurred by other programs 
used by experimentals. The net direct and indirect cost of a program 
subtracts from this gross cost all direct and indirect expenses of working 
with controls. 

Applying the Cost Measures 

There is no single "correct" measure of program cost. Each of the 
fourmeasures -gross direct cost, net direct cost, gross directand indirect 
cost, and net direct and indirect cost - has particular advantages and ap- 
plications. Which is the best one to choose depends on how it is to be used . 
The experience of the SWIM program in San Diego illustrates this. In this 
program, operated by San Diego County's Department of Social Services 
(DSS), a welfare recipient was required to participate in job search (oper- 
ated by DSS); if unsuccessful in getting a job, she was then assigned to 
work experience (also operated by DSS); finally, if still without a job. 



* As discussed further below, indirect costs associated with such systematic referrals may 
properly be considered part of the gross cost of the pro^\ram treatment. However, these 
referrals do not geruTate direct costs, since the administering agency has no financial 
responsibility for or control over the services that result. 
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she was referred to education and training (DSS made these referrals and 
provided the support services, but the primary services were delivered 
and funded by adult schools, community colleges, and the JTPA system). 
Participation in all three stages of the program treatment was monitored 
by DSS. 

What was the cost of SWIM? As shown in Table A.l, the total cost to 
DSS of operating the program was $842 per targeted case - the gross 
direct cost per experimental in the SWIM evaluation.* This includes the 
costs of DSS case managers, job club leaders, work experience placement 
staff, and other program personnel, as well as the costs of child care 
(some of which was provided by other agencies under contracts paid by 
DSS), transportation, and allowances paid when experimentals obtained 
employment. For budgeting purposes, this is the most pertinent cost 
figure for a welfare agency that wants to operate a program like SWIM, 
assuming it can develop similar arrangements with local education and 
training providers. 

The cost to DSS of processing controls, including the allowances 
they received in connection with their self-initiated employment, was 
$199 per control.^ Thus, the net direct cost to DSS of operating SWIM - 
the additional cost of the program to the agency beyond what it spent 
on the control group - was $643 ($842 minus $199). This, then, is the ad- 
ditional investment in its welfare caseload made by the administering 
agency in implementing SWIM. 

Like most current JOBS program operators, San Diego DSS relied on 
existing community resources to provide education and training to 
SWIM enrollees. Education and training were an integral part of the 
SWIM treatment, but DSS did not pay for them and had no direct 
operational control over them. The cost of these services was incurred by 
adult schools, community colleges, and JTPA programs in San Diego; it 
amounted to $703 per experimental.^ When this cost is included, the 



Here, as elsewhere, cost is expressed per experimentnl, not per participant, 

^ Table A.l does not include separate columns showing costs for controls, They may be 
calculated by subtracting net from gross costs. Thus, in SWIM, the total (direct and indi- 
rect) cost per control was $626 ($1,345 minus $919); the direct cost was $199 ($842 minus 
$643); and the indirect cost was $427 ($626 minus $199). 

This includes expenses incurred by the GAIN program, which succeeded SWIM, for 
members of the experimental group; experimentals who were still enrolled in SWIM when 
the program ended were transferred to GAIN. 
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gross direct ($842) and indirect ($703) cost of the program totals $1,545 
per experimenta 1. This figure reflects the full expenditure, by all agencies, 
on the SWIM treatment. 

However, on their own initiative, controls in San Diego were free to 
enroll in education and training, including the activities in which SWIM 
experimental were required to participate. As noted earlier, the cost of 
these (indirect) services was $427 per control group member. Thus, the 
net direct and indirect cost of SWIM - the gross cost of the treatment 
minus the direct cost per control of processing and allowances ($199), 
minus the indirect cost per control for educarion and training services 
provided by other programs ($427) - was $919. This represents the net 
investment of resources made per SWIM enroUee by all agencies. 

Costs of Wel£are-to-Work Programs 

Table A.l presents the costs of selected programs discussed in this 
book. Some of these programs did not have their costs measured using 
all four definitions. For example, indirect costs were not measured for the 
Baltimore program. There the costs of education and training that were 
provided as part of the program treatment were incurred by the operat- 
ing agency under contracts with service providers; thus, they are 
included in direct costs. However, the costs to other programs - the 
schools and training programs that did not have contracts with the 
Baltimore program - were not estimated. 

The direct costs reported in the table were all measured using 
program accounting and enrollment data, and exclude research-related 
expenses. Indirect costs were estimated using various ( )ther data sources. 
For San Diego I and Supported Work, most of the data were gathered 
using surveys administered to the research sample members For other 
programs in which such data were collected, JTPA, community college, 
and/or adult school program enrollment and accounting data were 
used. The data came from automated JTPA and school records covering 
a broad range of programs in all cases except Virginia, where school 
data came from paper records and were collected only for a subsample 
of the overall research sample, and Arkansas, where JTPA data were 
obtained for selected training programs only. 

The costs discussed in Chapters 3 through 5 are the net costs of the 
program treatments under study - the additional cost of serving 
experimental over the cost of serving controls. In most instances, tliese 
are the net direct costs shown in the second column of Table A.l. 




TABLE Al ESTIMATED COSTS PER EXPERIMENTAL OF SELECTED 
WELFARE-TO-WORK PROGRAMS 



Direct and Indirect 
Direct Costs Costs 

Program Gross Net Gross Net Data Sources 



Broad'Coverage: AFDC 



Arkansas 


$122 


$118 






A I 


Baltimore 


1,050 


953 


N/A 


N/A 


A 


Cook County: Job search only** 


107 


102 


391 


127 


A,J,C 


Cook County: job search/ 










A,j,C 


work experience 


154 


1 ;9 


421 


157 


Louisville Croup job Search 


552 


230 


N/A 


N/A 


A 


Louisville Individual job Search 


171 


136 


N/A 


N/A 


A 


San Diego I: job search only^ 


673 


562 


835 


510 


A,S,0 










577 


A,S,0 


work experience 


761 


636 


875 


San Diego SWIM 


842 


643 


1 R.IC 
l,34j 


01 Q 


A ! f " P 


Virginia 






Oil 




A 1 C F 


West Virginia 






M / A 


M / A 


A 


Droad-Coverage: Aruu-Ul* 












Baltimore 


o4v^ 


CCD 




M/ A 


A 
r\ 


San Diego 1: Job search only*^ 


699 


586 


809 


543 


A,S,0 


San Diego I: job search/ 










A,S,0 


work experience 


850 


727 


836 


672 


San Diego SWJM 


801 


604 


1,292 


817 


A,J,C,E 


West Virginia 


537 


136 


N/A 


N/A 


A 


Selective- Voluntary: AFDC 












AFDC Homentaker-Home 












Health Aide 


9,505 


9,505 


N/A 


N/A 


A 


Maine 


2,679 


2,019 


2,813 


2,286 


AJ 


New Jersey 


1,197 


787 


1,642 


860 


AJ 


Supported Work 


17,981 


17,981 


N/A 


17,528 


A,S 



SOURCES: Direct costs were estimated using program accounting and tracking data (A). Indirect 
costs were estimated using sources indicated in the last column of the table: program accounting and 
trackingdata(A);surveysoirhe research sample(S);jTPAdata (J), which covers only selected training 
programs for Arkansas; community college data (C); adult education data (E); and other records (O). 
N/A indicates that indirect cost estimates are not available. Estimates are calculated from data in 
Friedlander et al., 1985b (Arkansas); Friedlander et al, 1985a (Baltimore); Friedlander et al., 1987 
(C(H)k County); C;()ldman, 1981 (Louisville); Goldman, Friedlander, and Long, 1986 (San Diego I); 
Hamilton and Friedlander, 1989 (San Diego SWIM); Riccio et al., 1986 (Virginia); Friedlander at al., 
1986 (West Virginia); Orr, 1987 (Homemaker-Home Health Aide); Auspos, Cave, and Long, 1988 
(Maine); Freedman, Bryant, and Cave, 1988 (New jersey); Kemper, Long, and Thornton, 198! 
(Supported Work); unpublished MDRC data for Arkansas, San Diego I, Virginia, and West Virginia. 

NOTES: "Directcosts" are those incurred by theoperatingagency, while 'indirect costs" were incurred 
by other agencies; ''gross costs' a re the full costs per ex perin u»nta 1, whi le 'net c()sts'' subtract from gross 
costs the costs of serving controls. Cost estimates shown in boldface type best reflect the net cost of 
servicesintheintended service sequence; thesearethecostscited in this volume(scH?Appendix Atext 
for details). 

(cotilinued) 
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TABLE Al (coutimwd) 

San Diego I costs are expressed in 1983 dollars; Arkansas, Baltimore, Virginia, and West Virginia 
costs are in 1984 dollars; Maine costs are in 1985 dollars; Cook County, New Jersey, and San Diego 
SWIM costs are in 1986 dollars; AFDC Homemaker-Home Health Aide costs, which are presented as 
a range across states, were measured duringthe 1983-86 period; and Louisville Individual Job Search, 
Louisville Group Job Search, and Supported Work costs have been adjusted to reflect 1985 dollars, 

The direct costs incurred by Supported Work and the AFDC Homemaker-Home Health Aide 
Demonstrations include wages paid to participants; those amounted to $8,535 per experimental for 
Supported Work (in 1985 dollars) and $3,821 per experimental in the AFDC Homemaker-Home 
Health Aide Demonstrations (averaged across seven states). The direct costs in Maine, New Jersey, 
and Baltimore include the program's share of on-the-job training wages (employers also paid a share); 
these amounted to $384 in Maine, $348 in New Jersey, and $10 and $4 in Baltimore for AFDC and 
AFDC-UP experimental, respectively. 

'^Costs are presented for both the job search and job search/work experience sequences in San 
Diego I and C H)k County for informational purposes. The participation and impact findings 
presented in the body of this book for both programs are for the job search/work experience 
sequence. 

^Costs for the AFDCMJPprograms in Baltimoreand West Virginia arepresenttHi for informational 
purposes. The impact results are not presented in the body of this bt>ok because the sample size in 
Baltimore was ttH) small to produce reliable impact findings and the West Virginia study produced 
uncertain results. 
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However, in the SWIM, Cook County (Chicago), and Virginia programs, 
agencies other than the operating agency delivered integral parts of the 
program treatment (as defined by the operating agency), which were not 
paid for with program funds. For these programs, the net direct and 
indirect costs shown in the table's fourth column are used in this book. 

Comparing Costs Across Programs 

Readers should bear several points in mind when comparing pro- 
gram costs. In comparing gross direct costs, it is important to realize that, 
because of differences in program treatments and program funding 
arrangements, costs include different types of services and assistance. 
The Supported Work and AFDC Homemaker-Home Health Aide treat- 
ments included program wages paid to participants ($8,535 per Sup- 
ported Work experimental and $1,930 to $5,936, depending on the site, 
per Homemaker-Home Health Aide experimental), and the Maine and 
New Jersey programs paid for a share of OJT wages ($384 and $348 per 
experimental, respectively); the other programs (except Baltimore, 
which paid a small amount of OJT wages) did not incur comparable 
direct costs. Supported Work's direct costs also included work project 
operating expenses; many of the work projects also produced revenues 
that can be considered a partial offset to project expenses.'' The Baltimore 
and Maine programs had contracts with education and training service 
providers to deliver services as part of their treatments, so these expens- 
es are counted as direct costs; other programs relied on other agencies 
to provide such services with their own funding, so the costs of such ser- 
vices appear as indirect costs. The programs also differed in the extent 
to which they directly provided child care, transportation assistance, 
and allowances for other employment- and training-related expenses. 

In addition, the costs of the broad-coverage programs (the first two 
categories of entries in the table) differed from those of the four 
selective-voluntary f ograms in two important respects. First, the 



Suppi)rted Work operated work projects in which groups of Supported Workers were 
assignt^d to building maintenance, housing rehabilitation, retail operations (such as a gas 
station), and many other lypt»s of work. Many of these projects generated revenues for the 
program. Supported Work's project revenue amounted to $4,352 per experimental (in 1985 
dollars), which is almost a quarter of the program's total direct cost. This revenue was not 
subtracted from the program costs presented in Table A.l. 
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broad-coverage programs incurred expenditures associated with pro- 
cessing the AFDC caseload and enforcing mandatory program participa- 
tion requirements; such costs are particularly noteworthy for San Diego 
SWIM. The selective-voluntary programs obviously did not have these 
costs, although some processing and monitoring costs may have been 
incurred by the local WIN program. For example, some of the individ- 
uals who volunteered to be in the New Jersey OJT program were 
WIN-mandatories, and their involvement in the OJT program satisfied 
WIN's participation requirements; the costs of monitoring these cases 
for compliance with these requirements wa?= borne by WIN. 

Second, the broad-coverage programs were targeted to large seg- 
ments of the welfare caseload. Thus, the costs of the programs per 
experimental are averaged across many nonparticipants as well as 
participants. The voluntary programs were targeted to welfare recipients 
who wanted to be in the programs, so most experimentals were also 
participants. Thus, differences in total program costs reflect not only 
differences in the costs of employment and training activities per se, but 
also differences in the costs of administration and monitoring (see the 
discussion in Chapter 2). 

In comparing the net direct costs of programs, it is also important to 
recognize that the treatment of controls by the administering agencies 
differed greatly across the evaluated programs. In Supported Work and 
the AFDC Homemaker-Home Health Aide Demonstrations, the admin- 
istering agencies did not work with controls at all; thus, gross and net 
direct costs are the same. In Arkansas, Chicago, and Virginia, the agen- 
cies' only contact with controls was for WIN processing, so gross and 
net costs differed very little. In San Diego SWIM, the direct cost for con- 
trols iDnsisted primarily of the cost of processing them but also includ- 
ed allowances for their self-initiated employment. In the other 
broad-coverage programs - Baltimore, San Diego I, West Virginia, and 
both Louisville programs - some controls received WIN program treat- 
ments of various kinds. For example, controls in Baltimore received 
counseling and training referrals similar to what was provided in the 
predecessor WIN program. In the Louisville Group Job Search demon- 
stration, some controls received individual job search and placement 
assistance, as v ell as other WIN services. The significance of the services 
provided to controls is that they define the net cost of operating the 
program for experimentals (as well as the comparison that yields the net 
program impact estimates discussed in this voIumtO. 



260 



FROM WELFARE TO WORK 



Finally, several issues should be borne in mind when comparing the 
gross and net versions of direct and indirect costs. Because of the 
differences in data sources described above and in Table A.l, some of 
the estimates of indirect costs are based on partial data. For example, 
the estimates for Arkansas, Maine, and New Jersey are based on JTPA 
data only (and in Arkansas the JTPA data did not cover all training 
programs). On the other hand, the data for San Diego SWIM and Vir- 
ginia cover most of the publicly supported education and training 
options available to v/elfare recipients. 

Readers should also note that the indirect costs in Cook County 
(Chicago), San Diego SWIM, and Virginia reflect education and training 
that v^as an integral part of the program treatment, even though the 
services were not paid for by the administering agencies; these indirect 
costs were sizable. In other programs, indirect costs v^ere smaller and 
could either be greater or less than zero, depending on whether the 
program's complementary or substitution effects were relatively great- 
er. For example, total direct and indirect costs for Supported Work are 
lower than direct costs because the substitution effect dominated: i.e., 
more controls than experimental participated in education and training 
programs other than Supported Work. 
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Appendix B 

Supplemental Tables 
for Chapter 4 



TABLE B.1 SUMMARY AND QUARllRLY IMPACTS OF THE ARKANSAS 
WORK PROGRAM ON AFDC ELIGIBLcS 



Experimental Control Percentage 
Outcome and Follow-Up Period Group Mean Group Mean Difference Change 



Ever Employed; Quarters 2-12* 


41.0% 


36.2% 


4.8** 


13% 


Average Number of Quarters with 










Employment, Quarters 2-1 2^ 


2.44 


1.86 


0.58*** 


31% 


Ever Employed 










Quarter of Random Assignment 


18.0% 


12.3% 


5.7*** 


46% 


Quarter 2 


16.6 


11,6 


5.1*** 


44 


Quarter 3 


18.9 


13.5 


5.4*** 


40 


Quarter 4 


20.4 


16.7 


3.7* 


22 


Quarter 5 


21.4 


17.2 


4.3** 


25 


Quarter 6 


21.2 


15.8 


5,5*** 


35 


Quarter 7 


22.8 


17.6 


5.2** 


30 


Quarter 8 


23.9 


20,3 


3.6 


18 


Quarter 9 


24.1 


18.0 


6.1*** 


34 


Quarter 10 


25.2 


18.3 


6.9*** 


38 


Quarter 11 


24.9 


18.6 


6.3*** 


34 


Quarter 12 


24.5 


18.3 


6.2*** 


34 



Avera Total Earnings, 

Quartc.s 2-12* $3,165 

Average* Total Earnings 

Quarter of Random Assignment $1 1 1 

Quarter 2 156 

Quarter 3 190 

Quarter 4 217 

Quarter 5 229 

Quarter 6 294 

Quarter 7 305 

Quarter 8 351 

Quarter 9 353 

Quarter 10 357 

Quartern 352 

Quarter 12 360 



$2,468 $697** 28% 

$80 $31* 39% 

98 58** 59 

142 48* 34 

187 30 16 

201 29 14 

225 69* 31 

243 61 25 

288 64 22 

250 U)4** 42 

262 95** 36 

295 57 19 

278 81* 29 
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TABLE Bl (continued) 



Experimental Control Percentage 
Outcome and Follow-Up Period Group Mean Group Mean Difference Change 



Ever Received Any AFEXZ Payments, 

Quarters M2 75.3% 79.5% .4.2* -5% 
Average Number of Months Receiving 

AFDC Payments, Quarters M2 15.14 17.78 - 2.64*** -15% 
Ever Received Any AFDC Payments 



Quarter of Random Assignment 


66.4% 


69.4% 


-3.0 


-4% 


Quarter 2 


65.4 


71.5 


-6.1** 


-9 


Quarters 


56.7 


63.8 


-7.1*** 


-11 


Quarter 4 


51.0 


59.1 


-8.1*** 


-14 


Quarter 5 


48.0 


55.6 


- 7.6*** 


-14 


Qusiter 6 


43.6 


52.5 


- 8.9*** 


-17 


Quarter 7 


40.1 


50.0 


-9.9*** 


-20 


Quarters 


38.1 


46.0 


- 7.9*** 


-17 


Quarter 9 


36.4 


44.5 


-8.1*** 


-18 


Quarter 10 


34.8 


42.9 


-8.1*** 


-19 


Quartern 


35.6 


42.4 


- 6.8** 


-16 


Quarter 12 


32.8 


40.1 


- 7.3*** 


-18 



Average Total AFDC Payments 

Received, Quarters 1-12 $2,533 

Average Total AFIX Payments 
Received 

Quarter of Random Assignment $248 

Quarter 2 274 

Quarters 245 

Quarter 4 231 

Qjarter5 213 

Quarter 6 194 

Qua*1er7 193 

QuarttfrS 193 

Quarter 9 190 

Quarter 10 186 

Quartern 1»6 

Quarter 12 180 



Sample Si/e 560 



$3,036 -$502*** -17% 



$261 $13 «5% 

318 44*** - 14 

292 -47*** -16 

272 - 41*** -15 

259 -46*** - 18 

244 - 50*'** - 20 

245 - 52*** - 21 
235 -41*** -17 
241) - 49*** - 20 
232 46*** - 20 
224 ^38*'* -17 
215 -35** -16 
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TABLE B*l (cofitmued) 

SOURCE: Adapted fron Friedlanderand Goldman^ 1988. 

NOTES: The earnings and AFDC payments data include zero values for sample members not employed and 
for sample membt»rs not receiving welfare. Estimates are regression-adjusted using ordinary least squares, 
controlling for pre-random assignment characteristics of sample members. There may be some discrepancies 
in experimental-control differences because of rounding. 

For employment and earnings, the quarter of random assignment refers to the calendar quarter in which 
random assignment occurred. For AFDC payments, the quarter of ralidom assignment refers to the three 
months beginning with the month in which an individual was randomly assigned. 

A two-tailed t-test was applied to differences between experimental and control groups. Statistical 
significance levels are indicated as: * := 10 percent; ** = 5 percent; and *** = 1 percent. 

^Quarter 1 , the quarter of random assign men t, may contain some earnings from the period prior to random 
assignment and is therefore excluded from the summary measures of follow-up for employment and 
earnings. 
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TABLE B.2 SUMMARY AND QUARTERLY IMPACTS OF THE BALTIMORE 
OPTIONS PROGRAM ON AFDC ELIGIBLES 



Outcome and FoIIow-Up Period 



Ever Employed, Quarters 2-12^ 

Average Number of Quarters with 
Employme^it, Quarters 2-12^ 

Ever Employed 
Quarter of Random Assignment 
Quarter 2 
Quarters 
Quarter 4 
Quarters 
Quarter 6 
Quarter 7 
Quarters 
Quarter 9 
Quarter 10 
Quartern 
Quarter 12 



Experimental 
Group Mean 



70.3% 



Control 
Group Mean 



Percentage 
Difference Change 



65.5% 



4.8» 



7% 



4AQ 


3.73 




1 no/ 
10% 


28,0% 


26.1% 


1.9 


7% 


27.0 


23,5 


3.4»» 


14 


32.3 


27.4 


49»»» 


18 


34,7 


31,2 


3.5»» 


11 


36.3 


1,8 


43*** 


14 


38,7 


33,0 


5.7*** 


17 


38.8 


34.9 


3.8»» 


11 


39,5 


37.1 


2.4 


6 


39.5 


37.4 


2.1 


6 


40.8 


37,7 


3.1» 


8 


42.0 


38,1 


3.9»» 


10 


40.7 


40,3 


0.4 


1 



Average Total Earnings, 

Quarters 2-12' $7,638 

Average Total Earnings 

Quarter of Random Assignment $260 

Quarter 2 31^ 

Quarter 3 4^ 

Quarter 4 5^1^ 

Quarter 5 575 

Quarter 6 5^ 

Quarter 7 755 

Quarter 8 7^(7 

Quarter 9 777 

Quarter 10 g9Q 

Quartern 9^4 

Quarter 12 010 



$6,595 $1,043»»» 16% 



$251 $8 3% 

325 -8 -2 

400 66* 17 

495 73» 15 

512 64* 12 

566 103»* 18 

630 126»** 20 

679 108»» 16 

659 118** 18 

741 157»** 21 

766 138*»» 18 

822 98» 12 
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TABLE B*2 (continued) 



Outcome and FoIIow-Ud Period 


Experimental 


Control 

\jiuiip ivicori 


lyirrerence 


Percentage 
v.,nange 


Ever Received Any AFDC Payments, 










Quarters 1*12 


95.3% 


95.4% 


-0.1 


0% 


Average Number of Months Receiving 










AFDC Payments, Quarters M2 


22.21 


22.63 


-0.42 


-2% 


Ever Received Any AFDC Payments 










Quarter of Random Assignment 


92.4% 


92.1% 


0.4 


0% 


Quarter 2 


87-4 


87.5 


-0.2 


0 


Quarter 3 


77.5 


78.3 


-0.7 


-1 


Quarter 4 


72.0 


73.3 


-1.4 


-2 


Quarter 5 


69.1 


70.4 


-1.4 


-2 


Quarter 6 


64.9 


66.4 


-1.5 


-2 


Quarter 7 


61.3 


61.8 


-0.5 


-1 


Quarters 


58.7 


59.0 


-0.3 


-1 


Quarter 9 


55.2 


56.7 


-1.6 


-3 


Quarter 10 


52.8 


54.5 


-1.7 


-3 


Quarter 11 


49.9 


52.0 


-2.1 


*4 


Quarter 12 


48.2 


48.4 


-0.2 


0 


Average Total AFDC Payments 










Received; Quarters M2 $6,361 


$6;424 


-$63 


-1% 


Average Total AFDC Payments 










Received 










Quarter of Random Assignment 


$681 


$675 


$6 


1% 


Quarter 2 


680 


675 


5 


1 


Quarter 3 


594 


597 


-2 


0 


Quarter 4 


565 


571 


-6 


-1 


Quarter 5 


545 


558 


-13 


-2 


Quarter 6 


519 


532 


-12 


-2 


Quarter 7 


504 


511 


-6 


-1 


Quarter 8 


489 


492 


-2 


-1 


Quarter 9 


480 


484 


.4 


-1 


Quarter 10 


451 


463 


-12 


-3 


Quartern 


427 


445 


-18 


-4 


Quartern 


425 


423 


3 


1 


Sample Size 


1;362 


1;395 
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TABLE B*2 (continued) 



SOURCE: Adapted from Friedlander, 1987. 

NOTES: The earnings and A¥DC payments data include zero values 'hr ^mple members not employed and 
for sample members not receiving welfc^re. Estimates are regression-adjusted using ordinary least squares, 
controlling for pre-random assignnient characteristics of sample members. There may be some discrepancies 
in experimental-control differences because of rourding. 

For employment and earnings; the quarter of random assignment refers to the calendar quarter in which 
random assignment occurred. For AFDC payments, the quarter of randon^. assignment refers to the three 
months beginning with the month in which an individual was randomly assigned. 

Alwo-tailedt-testwasappliedlodifferences between experimentalandcontrolgroups.Statisticalsignific 
levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 

^Quarter 1, the quarter of random assig.iment, may contain some earnings from the period prior to random 
assignment and is therefore excluded from the summary measures of follow-up for employment and 
earnings. 
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TABLE BJ3 SUMMARY AND QUARTERLY IMPACTS OF THE COOK COUNTY 
WIN DEMONSTRATION ON AFDC ELIGIBLES 



Outcome and Follov -Up Period 


Experimental 
Group Mean 


Control 
Group Moan 


Difference 


Percentage 
Ghdnge 


Ever Employed; Quarters 2-6^ 


36.8% 


35.8% 


1.0 


3% 


Average Number of Quarters with 










Employment; Quarters 2-6^ 


1.09 


1.05 


0.04 


4% 


Ever Employed 










Quarter of Random Assignment 


16.3% 


16.2% 


0.1 




Quarter 2 


17.9 


17.8 


0.1 


1 


Quarter 3 


20.8 


20.1 


0.7 


3 


Quarter 4 


ZZ.D 




1.3 


6 


Quarter 5 


23.3 


22.4 


0.8 


4 


Quarter 6 


24.4 


23.4 


1.0 


4 


Average Total Earnings; 










Quarters 2-6*^ 


$1;977 


$1;921 


$57 




Average Total Earnings 










Quarter of Random Assignment 


$183 


$184 


-$1 


- 1% 


Quarter 2 


281 


286 


-6 


-2 


Quarters 


359 


354 


5 


1 


Quarter 4 


405 


394 


11 


3 


Quarter 5 


437 


412 


24 


6 


Quarter 6 


496 


475 


21 


s 



Ever Received Any AFDC Payments; 

Quarters 1-6 99.8% 99.8% -0.1 0% 
Average Number of Months Receiving 

AFDC Payments, Quarters 1-6 1 4.23 1 4.45 - 0.22** - 2% 



Ever Received Any AFIX: Payments 



Quarter of Random Assignment 


99.6% 


99.67. 


0.0 


Quarter 2 


92,5 


92.6 


-0.1 


Quarter 3 


K3.9 


85.5 


' 1.6** 


Quarter 4 


78.9 


80.8 


-1.9** 


Quarters 


75.1 


77.1 


- 2.0** 


Quarter 6 


70.9 


727 


-1.8* 



-3 
-2 
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TABU (continued) 



Outcome and Follow-Up Period 


P V r>pri mp n fr;) 1 

Group Mean 


"ontrol 

Group Mean Difference 


Percentage 
Change 


Average Total AFDC Payments 










Rxreived, Quarters 1-6 


K416 


$4,486 


-$70* 


-2% 


Average Total AFDC Payments 










Received 










Quarter of Random Assignment 


$842 


$833 


$9*» 


1% 


^^U(t^le^ z 


824 


824 


0 


0 


Quarter 3 


740 


763 


-23*** 


-3 


Quarter 4 


700 


726 


- 26*** 


-4 


Quarter 5 


675 


690 


-16* 


-2 


Quarter 6 


636 




-14 


-2 


Sample Size 


4;050 


3,805 







SOURCE: Adapted from Friedlander et al, 1987. 

NOTES: The earnings and AFDC payments data include zero values for sample members not employed and 
for sample members not receiving welfare. Estimates are regression-adjusted using ordinary least squares, 
controlling for pre-random assignment characteristics of sample members. There may be some discrepancies 
in experimental-control differences because of rounding 

For employment and earnings, the quarter of random assignment refers to the calendar quarter in which 
random assignment occurred. For AFDC payments, the quarter of random assignment refers to the three 
months beginning with the month in which an individual was randomly assigned. 

A two-tailed t-test was applied to differences between experimental and control groups. Statistical 
significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 

Quarter l,thequarter of random assignment,maycontainsomeearnings from the period prior to random 
assignment and is therefore excluded from the summary measures of follow-up for employment and 
earnings. 
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TABLE B.4 SUMMARY AND QUARTERLY IMPACTS OF SAN DIEGO I 
(EPP/EWEP) ON AFDC ELIGIBLES 



^^Ulk 1 IV Ml lU ■ TV L/ I vl IVVl 


Experimental 


Control 




Percentage 


r.rDiin \At>^r\ 
vjiuup ivicaii 


vjioup iviean 


Difference 


Change 


Ever Employed, Quarters 2-6'^ 


61.0% 


55.4% 


5.6*** 


10% 


Average Number of Quarters with 










Employment, Quarters 2-6*^ 


2.03 


1.73 


0,29*** 


17% 


Ever Employed 










Quarter of Random Assignment 


35.5% 


.33.1% 




O iX> 


Quarter 2 


35.6 


28.7 


6.9*** 


24 


Quarter 3 


40.2 


32.3 


7.8*** 


24 


Quarter 4 


42.4 






ID 


Quarter 5 


42.9 


37.5 


5.4*** 


14 


Quarter 6 


41.9 


38.1 


3.8* 


10 


Average Total Earnings, 










Quarters 2-6 $3,802 


$3,102 


$700*** 


23% 


Average 1\)tal Earnings 










Quarter of Random Assignment 


$3.59 






/ /i: 


Quarter 2 


510 


369 


141»»* 


38 


Quarter 3 


701 


538 


163'** 


3tt 


Quarter 4 


810 




1 1 7»» 

11/ 


1*7 
1/ 


Quarter 5 


848 


729 


119»» 


16 


Quarter 6 


933 


773 


161»*» 


21 


Ever Received Any AFDC I\iyments, 










Quarters 1-6 


83.9% 


84.3% 


-0.4 


0% 


Average Number of Months Receiving 










AFDC Payments, Quarters 1-6 


8.13 


8.61 


- 0.48* 




Ever Received Any AFDC Payments 










Quarter of Random Assignment 


78.3% 


8{).3% 


-2.0 


- 2% 


Quarter 2 


64.2 


67.6 


-3.4* 


-5 


Quarter 3 


51.8 


56.2 


- 4.5** 


-8 


Quarter 4 


45.8 


47.9 


-2.0 


-4 


Quarter 5 


39.5 


41.1 


-1.7 


-4 


Quarter 6 


35.0 


36.2 


- \2 


-3 
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TABLE B.4 (continued) 



Experimental Control Percentage 
Outcome and FollowUp Period Group Mean Group Mean Difference Change 

Average Total AFDC Payments 
Received, Quarters 1-6 

Average Total AFDC Payments 
Received 

Quarter of Random Assignment 

Quarter 2 

Quarter 3 

Quarter 4 

Quarter 5 

Qua Iter 6 

Sample Size 1^502 K73 



$3,409 


$3,697 


- $288** 


-8% 


$734 


$752 


-$18 


-2% 


695 


765 


-70*** 


-9 


582 


653 


-71*** 


-11 


513 


580 


-67** 


-11 


462 


501 


-39 


-8 


423 


445 


-22 


-5 



SOURCE: Adapted from Goldman, Friedlander, and Long, 1986. 

NOTES: The earnings and AFDC payments data include zero values for sample members not employed and 
for sample members not receivmg welfare. Estimates are regression-adjustJd using ordinary least Lar^ 

controllingfcTpre-randomassignmentcharaderisticsof sample membe4. There maybe somLiscrtS^^^^ 
in experimental-control differences because of rounding. may oesomediscrtpanues 

For employment and earnings, thequarterof random assignment refers to the calendar quarter in which 
random assignment occurred. For AFDC payments, the quarter of random assignment refer, to the th^e 
months begmning with the month in which an individual was randomly assigned. 

A two-tailed t-test was applied to differences between experimental and control groups Statistical 
significance levels are indicated as: • = 10 percent; " = 5 percentfand = 1 percent. 

.''Q"«rterl,lhequarterofrandomassignment,maycontainsomeeamingsfromthepericHlpriortorandom 
assignment and .s therefore excluded from the summary measures of'follow-upVor em'ploymlnt and 
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TABLE B,5 SUMMARY AND QUARTERLY IMPACTS OF THE SAN DIEGO 
SWIM PROGRAM ON AFDC ELIGIBLES 



Outcome and Follow-Up Period 



Experimental Control 
Group Mean Group Mean 



Difference 



Percentage 
Change 



Ever Employed, Quarters 2-9 

Average Number of Quarters with 
Employment; Quarters 2-9 

Ever Employed 
Quarter of Random Assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter b 
Quarter 7 
Quarters 
Quarter 9 



62.5% 



272 



27.9% 

33.0 
33.6 
347 
34.9 
3^..6 
35.2 
347 



507% 



2.15 



25.1% 

247 

25.6 

25.8 

26.9 

26.7 

27.4 

28.4 

29.3 



11.9* 



0.58* 



27** 

6.1*** 

7.4*** 

7.8*** 

7.7*** 

8.2*** 

8.2*** 

6.8*** 

5.4*** 



23% 



27% 



11% 

25 

29 

30 

29 

31 

30 

24 

18 



Average TtHal Earnings, 
Quarters 2-9 

Average Total Earnings 



$4,932 



$3,923 



$1,009* 



26% 



Quarter of Random Assignment 


$274 


J>271 


$4 


V 


Quarter 7 


365 


339 


27 


8 


Quarter 3 


486 


401 


85** 


21 


Quart^?r 4 


568 


456 




25 


Quarter 5 


610 


482 


128*** 


27 


Quarter 6 


677 


484 


193*** 


40 


Quarter 7 


717 


545 


172**» 


32 


Q..arler 8 


743 


597 


146*** 


24 


Quarter 9 


766 


620 


146*** 


24 
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TABLE B.5 (continued) 



Outcome and Follow-Up Period 


Experimental 
Group Mean 


Control 
Group Mean 


Difference 


Percentage 
Change 


Ever Received Any AFDC Payments; 










Quarters 240 


92.1% 


92.9% 


-0.8 


-1% 


Average Number of Months Receiving 








AFDC Payments, Quarters 2-10 


16.31 


17.94 


- 1.63*** 


-9% 


Ever Received Any AFDC Payments 










Quarter of Random Assignment 


91.2?o 


91.4% 


-0.3 


0% 


Quarter 2 


89.7 


89.9 


-0.1 


0 


Quarter 3 


79.0 


81.6 


-2.5* 


-3 


Quarter 4 


70.6 


76.1 


- 5.5*** 


-7 


Quarter 5 


66.0 


72.4 


- 6.4*** 


-9 


Quarter 6 


60.9 


68.3 


- 7.3*** 


-11 


Quarter 7 


57.3 


64.7 


- 7.4*** 


- 11 


Quarters 


53.« 


60.6 


- 6,9*** 


- 11 


Quarter 9 


51.3 


58.7 


'•7.4*** 


-13 


Quarter 10 


l«.l 


55.1 


-7.0*** 


-13 


Average Tota! AFDC Payments 










Received, Quarters 2-10 


$8,590 


$9,687 


-$1,097*** 


- 11% 


Average Total AFDC Payments 










Received 










Quarter of Random Assignment 


$1,194 


$1,194 


$0 


0*/i 


Quarter 2 


1,286 


1,333 


-47** 


-4 


Quarter 3 


1,120 


1,225 


- 105*** 


-9 


Quarter 4 


1,032 


1,16() 


- 129*** 


- 11 


Quarter 5 


987 


1112 


- 125^^^ 


-11 


Quarte*' 6 


922 


1,065 


- 143*** 


- 13 


Quarter 7 


867 


1,011 


- 144^^* 


-14 


Quarter 8 


826 


963 


- 136*** 


-14 


Quarter 9 


792 


922 


. 129'** 


-14 


Quarter 10 


758 


896 


- 137^^^ 


-15 


Sample Size 


\M)4 


1,607 







(LVfttmued) 
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(continued) 

SOURCE: Adapted from Hamilton and Friedlander, 1989. 

NOTliS: The earnings and AFDC payments data include zero values for sample members not employed ai 
for sample members not receiving welfare. Estimates are regression-adjusted using ordinary least squan 
controlUng for pre-random assignment characteristics of sample members. There may be some discrepand. 
in expt«rimental-controI differences because of rounding. 

For all outcomes, the quarter of random assignment refers to the calendar quarter in which rando 
assignment occurred. Quarter 1, the quarter of random assignment, may contain some earnings and AFD 
paymeits from the period prior to random assignment and is therefore excluded from all summary measun 

of folloiV-Up. 

A two-tailed t-test was applied to differences between experimental and control groups. StaHsHc 
significance levels are indicated as: • = 10 percent; = 5 percent; and •** = 1 percent. 
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TABLE B.6 SUMMARY AND QUARTERLY IMPACTS OF THE VIRGINIA 
EMPLOYMENT SERVICES PROGRAM ON AFDC ELIGIBLES 



Experimenlal Conlrol Percenlage 
Outcome and Follow-Up Period Group Mean Group Mean Difference Change 



Ever Employed; Quarters 2-10^ 63.2% 58.9% 4.4** 7% 
Average Number of Quarters with 

Employment Quarters 2-10^ 3.18 2.85 0.33*** 12% 

Ever Employed 

Quarter of random Assignment 27.3% 26.1% 1.2 5% 

Quarter 2 28.3 26.7 1.6 6 

Quarters 31.3 28.0 3.3** 12 

Quarter 4 34.7 31.0 3.8** 12 

Quarters 35.8 33.1 2.6 8 

Quarter 6 35.2 32.1 3.2* 10 

Quarter 7 36.4 32.3 4.1** 13 

Quarter 8 39.3 33.3 6.0*** 18 

Quarter 9 38.4 34.1 4.3** 13 

Quarter 10 38.7 34.1 4.6*** 13 



Average Total Earnings, 










Quarters 2-10^ 


H710 


$4;222 


$488* 


12% 


Average Total Earnings 










Quarter of Random Assignment 


$222 


$227 


.$4 


-2% 


Quarter 2 


286 


290 


-4 


-1 


Quarters 


384 


350 


VI 


10 


Quarter 4 


459 


416 


43 


10 


Quarter 5 


505 


459 


47 


10 


Quarter 6 


530 


482 


48 


10 


Quarter 7 


596 


520 


77* 


15 


Quarter 8 


636 


528 


109*** 


21 


Quarter 9 


650 


560 


89** 


16 


Quarter 10 


663 


618 


45 


7 



(cotttimied) 
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TABLE B,6 (continued) 





Experiment" 


Control 




Percentage 


Outcome and Follow-Up Period 


Group Meah 


Group Mean 


Difference 


Change 


Ever Received Any AFDC Payments; 










Quarters Ml 


87.5% 


87.4% 


0.2 


0% 


Average Number of Months Receiving 










AFDC Payments, Quarters 1-M 


16.64 


16.95 


-0.31 


-2% 


Ever Received Any AFDC Payments 










Quarter of Random Assignment 


82.9% 


83.0% 


-0.1 


0% 


Quarter 2 


76.5 


76.2 


0.2 


0 


Quarter 3 


66.9 


65.7 


1.2 


2 


Quarter 4 


59.8 


59.4 


0.4 


1 


Quarter 6 


56.2 


55.1 


\X 


2 


Quarter 6 


52.1 


51.7 


0.4 


1 


Quarter 7 


48.6 


47.8 


0.8 


2 


Quarter 8 


44.0 


44.9 


-0.9 


-2 




41.1 




- Z. 1 


- D 


Quarter 10 


38.5 


41.5 


-2,9* 


-7 


Quarter 11 


36.6 


39.3 


-2.6 


-7 


Average Total AFDC Payments 










Received, Quarters 1-11 


$4329 


$4317 


-$183 


-4% 


Average Total AFDC Payments 










Received 










Quarter of Random Assignment 


$549 


$554 


-$5 


-1% 


Quarter 2 


529 


550 


-21* 


-4 


Quarter 3 


457 


484 


-27** 


-6 


Quarter 4 


426 


441 


-15 


-3 


Quarter 5 


404 


407 


-3 


-1 




j<jj 


Jrj 1 




- ^ 


Quarter 7 


358 


362 


-4 


-1 


v^uaner o 






- zu 


- o 


Quarter 9 


312 


342 


- 3l)»* 


-9 


Quarter 10 


297 


326 


-30** 


-9 


Quarter 11 


279 


303 


-24* 


-8 


Sample Size 


2,119 


1,031 







(continued) 
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TABLE B.6 (continued) 



SOURCE: Adapted from FriedlandeF; 1988a. 

NOTES: The earnings and AFIX payments data include zero values for sample members not employed and 
for sample members not receiving welfare. Estimates are regression-adjusted using ordinary least squares, 
controlling for pre-random assignment characteristics of sample members. There may be some discrepancies 
in experimental-control differences because of rounding. 

For employment and earn: igs, the quarter of random assignment refers to the calendar quarter in which 
random assignment occurred. For AFDC pyments, the quarter of random assignment refers to the three 
months beginning wivh the month in which an individual was randomly assigned. 

A two-tailed t-test was applied to differences between experimental and control groups. Statistical 
significance levels aT^ indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 

^Quarter 1 , thequarter of random assignment, may contain someearnings from the period prior to random 
assignment and is therefore excluded from the summary measures of follow-up for employment and 
earnings. 
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TABLE B.7 SUMMARY AND QUARTERLY IMPACTS OF THE WEST VIRGINIA 
COMMUNITY WORK EXPERIENCE PRO GRAM 
ON AFDC ELIGIBLES 



Outcome and Follow-Up Period 


Experimental 
Group Mean 


Control 
Group Mean 


Difference 


Percentage 
Change 


Ever Employed, Quarters 2-6 


22.3% 


22.7% 


-0.4 


-2% 


Average Number of Quarters with 










Employment, Quarters 2-6^ 


0.58 


0.62 


-0.04 


-6% 


Ever Employed 










Quarter of Random Assignment 


8.4% 


9.2% 


-0.8 


-9% 


Quarter 2 


9.2 


9.9 


-0.8 


-8 


Quarter 3 


10.9 


11.2 


- 0.3 




Quarter 4 


12.0 


13.1 


-1.0 


-8 


Quarter 5 


12.7 


13.8 


-1.1 


-8 


Quarter 6 


T\4 


13.8 


-0.4 


-3 


Average Total Earnings, 










Quarters 2-6^ 


$713 


$712 


$0 


0% 


/werage i otai earnings 










Quarter of Random Assignment 


$69 


$73 


-$4 


-5% 


Quarter 2 


101 


95 


6 


6 


Quarter 3 


133 


112 


21 


19 


Quarter 4 


148 


155 


-7 


-4 


Quarter 5 


162 


173 


-11 


-6 


Quarter 6 


168 


178 


-9 


-5 



Ever Received Ai»y AFDC Payments, 










Quarters 1-7 


96.8% 


96.0% 


0.8 


1% 


Average Number of Months Receiving 










AFDC Payments, Quarters 1-7 


14.26 


14,46 


-0.21 


-1% 


EviT Received Any AFDC Payments 










Quarter of Random Assignment 


94.2% 


93.2% 


1.0 


1% 


Quarter 2 


87.6 


86.7 


0.9 


1 


Quarter 3 


78.0 


79.0 


-1.0 


-1 


Quarter 4 


70.9 


72.5 


-1.5 


-2 


Quarter 5 


65.5 


67.8 


-2.3 


-3 


Quarter 6 


61.8 


63.5 


-1.7 


-3 


Quarter 7 


57.8 


60.7 


-2.8* 


-5 
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TABLE B.7 (continued) 



Outcome and Follow-Up Period 


Experimental 
Group Mean 


Control 
Group Mean 


Difference 


Percentage 
Change 


Average Total AFDC Payments 










Received, Quarters 1-7 


$2;681 


$2;721 


-$40 


-1% 


Average Total AFDC Payments 










Received 










Quarter of Random Assignment 


$452 


$449 


$3 


1% 


Otf;«rtpr 7 




454 


5 


1 


Quarters 


411 


413 


-2 


0 


Quarter 4 


370 


377 


-7 


-2 


Quarter 5 


336 


351 


-15* 


-4 


Quarter 6 


329 


337 


-9 


-3 


Quarter? 


325 


341 


-16* 


-5 


Sample Size 


1,845 


1;834 







SOURCE: Adapted from Friedlander et al.; 1986. 

N0TF5: The earnings and AFDC payments data include zero values for sample mer * not employed and 
for sample members not receiving welfare. Estimates are regression-adjusted ubii ordinary least squares, 
controlling for pre-random assignment characteristics of sample members. There ma) be some discrepancies 
in experimental-control differences because of rounding. 

For employment and earnings, the quarter of random assignment refers to the calendar quarter in which 
random assignment occurred. For AFDC payments, the quarter of random assignment refers to the three 
months beginning with the month in which an individual was randomly assigned. 

A two-tailed t-test was applied to differences between experimental and control groups. Statistical 
sign'ficance levels are indicated as: * = 10 percent: ** = 5 percent; and = 1 percent. 

* 3uarterl,thequarterof random assignment, may containsomeearnings from the period prior to random 
assignai(?nt and is therefore excluded from the summary measures of follow-up for employment and 
earnings. 
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TABLE B.8 IMPACTS ON COMBINED EMPLOYMENT AND WELFARE RECEIPT 
STATUS OF THE SAN DIEGO SWIM PROGRAM, 
FOR AFDC ELIGIBLES 



Experimental Control Percentage 
Outcome and Follow-Up Period Group Mean Group Mean Difference Change 



Not Employed, Received AFDC 



Quarter of Random Assignment 


67.1% 


69.3% 


-2.3* 


-3% 


Quarter 2 


63.6 


69.7 


-6.1*** 


-9 


Quarter 3 


56.4 


63.8 


'73*** 


-11 


Quarter 4 


50.4 


60.3 


-9.9*** 


-16 


Quarter 5 


46.5 


57.0 


-10.4*** 


-18 


Quarter 6 


43.8 


54.9 


-11.1*** 


-20 


Quarter 7 


41.0 


52.2 


-11.1*** 


-21 


Quarter 8 


39.9 


48,3 


-8.4*** 


-17 


Quarter 9 


38.6 


46.8 


-8.2*** 


-18 



Average Rate, Quarters 2-9 47.5 56,6 -9.1*** -16 



Employed, Received AFDC 



Quarter of Random Assignment 


24.1% 


22.1% 


2.0 


9% 


Quarter 2 


26.1 


20.2 


5.9*** 


29 


Quarter 3 


22.6 


17,8 


4.8*** 


27 


Quarter 4 


20.3 


15.8 


4.4*** 


28 


Quarter 5 


19.5 


15.5 


4.0*** 


26 


'Quarter 6 


17.1 


13.4 


3.7*** 


28 


Quarter 7 


16.3 


12,6 


3.7*** 


29 


Quarter 8 


13.8 


12.3 


1.5 


12 


Quarter 9 


12.7 


11.9 


0.8 


7 



Average Rate, Quarters 2-9 18,6 14,9 3.6*** 24 



Employed, Did Not Receive AFDC 



Quarter of Random Assignment 


3,8% 


3,1% 


0.7 


23% 


Quarter 2 


4.6 


4.5 


0,1 


2 


Quarter 3 


10.4 


7.8 


2,6*** 


33 


Quarter 4 


13.4 


ID.O 


3.4*** 


34 


Quarter 3 


15.2 


11,5 


3.7*** 


32 


Quarter 6 


17.7 


13.3 


4.4*** 


33 


Quarter 7 


19.3 


14,9 


4.5*** 


30 


Quarter 8 


21.4 


16.1 


5.3*** 


33 


Quarter 9 


21.9 


17.3 


4.6*** 


27 



Average Rate, Quarters 2-9 15.5 11.9 3.6*** 30 



(continued) 



TABLE BS (continued) 



Experimental Control Percentage 
Outcome and Follov/~Up Periixi Group Mean Group Mean Difference Change 



Not Employed; Did Not 
Receive AFDC 



Quarter of Random Assignment 


5.1% 


5.5% 


-0.4 


-7% 


Quarter 2 


5.7 


5.7 


0.0 


0 




in c 


10.7 


-0.1 


-1 


Quarter 4 


16.0 


13.8 


2.1* 


15 


Quarter 5 


18.8 


16.1 


2.7»* 


17 


Quarter 6 


21.3 


18.5 


2.9** 


16 


Quarter 7 


23.4 


20.4 


3.0** 


15 


Quarter 8 


24.9 


23.3 


1.6 


7 


Quarter 9 


26.8 


24.0 


2.8* 


12 


Average Rate, Quarters 2-9 


18.4 


166 


1.9** 


11 



Sample Size 1,604 1;607 



SOURCE: Adapted from Hamilton and Friedlander, 1989. 

NOTES: Estimates are regression-ad just tnl using ordinary least squarc»S; controlling for pre-random 
assignment characteristics of sample members. There may be some discrepancies in experimental- 
control differences because of rounding. 

For all outcomes, the quarter of random assignment refers to the calendar quarter in which 
random assignment occurred. Quarter \, the quarter of random assignment, may contain some 
earnings and AFDC payments from the period prior to random assignment and is therefore excluded 
from all summar)' measures of follow-up. 

Atwtvtailed t- test was applied todifferences between experimentaland control groups. Statistical 
significance levels are indicated as: * = 10 percent; ** = 5 perwnt; and *** ^ 1 percent. The distributed 
differences are not, however, strictly independent. 
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TABLE 6.9 ADDITIONAL SUBGROUP IMPACTS OF FIVE 

WELFARE-TO-WORK PROGRAMS ON AFDC ELIGIBLES 



Subgroup, Welfare 
Status, and Program 


Percent 
of 

Sample^ 


Average Earning 
Per Quarter, 
Quarters 4 - Last 


5 


Average AFDC 
Payments Per Quarter, 
Quarters 4 - Last 


Experi- 
mental 


Controls Difference 


Expert- 
mentals 


Controls Difference 


High School Diploma 
















Applicants 
















Yes 
















San Diego I 


61.5 


$1,068 


$ 923 


$146** 


$375 


$420 


- ^rri 


Baltimore 


44.9 


1,199 


1,106 


92 


337 


337 


0 


Virginia 


50.8 


939 


912 


27 


175 


155 


21 


Arkansas . 


55.1 


557 


397 


161** 


118 


127 


- 9 


Cook County 


46.8 


958 


957 


1 


442 


457 


-15 


No 
















San Diego 1 


38.5 


609 


534 


74 


532 


547 


-15 


Baltimore 


55.1 


829 


593 


236»»» 


391 


416 


-25 


Virginia 


49.2 


694 


559 


136* 


206 


267 


-61** 


Arkansas 


44.9 


313 


970 




143 


ion 


- 47** 

- *t/ 


Cook County 


53.2 


461 


532 


-71 


495 


510 


-16 


Recipients 
















Yes 
















Baltimore 


42.1 


645 


598 


46 


557 


546 


10 


Virginia 


38.8 


650 


569 


80 


390 


378 


12 


Arkansas 


42.0 


180 


212 


-32 


245 


309 


-64^ 


Cook County 


30.9 


532 


467 


66* 


663 


684 


-20 


No 
















Baltimore 


57.9 


347 


317 


30 


679 


677 


2 


Virginia 


61.2 


363 


302 


61 


426 


474 


-48** 


Arkansas . 


58.0 


129 


73 


56 


311 


369 


-58*» 


Cook County 


69.1 


269 




10 

jy 


761 


771 
//I 


111 


Number of Own Children 














Applicants 
















One 
















San Diego 1 


49.7 


887 


807 


80 


346 


355 


- 9 


Baltimore 


50.4 


1,033 


766 


267*** 


299 


327 


-28 


Virginia 


49.6 


781 


696 


85 


174 


185 


- 11 


Arkansas 


42.5 


427 


391 


36 


106 


129 


-23 


More Than One 
















San Diego 1 


50.3 


895 


740 


155'» 


525 


580 


-56* 


Baltimore 


49.6 


966 


891 


75 


434 


434 


0 


Virginia 


50.4 


856 


780 


76 


207 


234 


-27 


Arkansas 


57.5 


467 


305 


i6r» 


148 


176 


-28 


Recipients 
















One 
















Baltimore 


43.1 


528 


493 


35 


503 


522 


-19 


Virginia 


42.0 


482 


426 


56 


325 


341 


-17 


Arkansas 


34.8 


125 


173 


-48 


192 


257 


-65* 


More Than One 
















Baltimore 


56.9 


430 


392 


38 


721 


696 


24 


Virginia 


58.0 


469 


391 


77 


475 


504 


-29 


Arkansas 


65.2 


164 


108 


56 


332 


390 


-58*- 



(continued) 



TABLE B.9 (continued) 



SubsrouD. Wplf;irp 

Status, and Program 


I erceni 

Of 

Sample^ 


Average Earnings 
Per Quarter, 
Quarters 4 - Last 


Average AFDC 
Payments Per Quarter, 
Quarters 4 - Last 


Experi- 
mentals 


Controls 


Difference 


Ex peri - 
mentals 


Controls 


Difference 


Ever Manied 


















Applicnnts 


















1 Co 


















San Diego 1 
Baltimore 
Virgmia 
Arkansas 

INO 


84.1 
69.9 
74.2 
56.9 


$ 908 
1,003 
830 
424 




$806 
821 
705 
310 


$102» 
182** 
125* 
114* 


$421 

170 
112 


176 
123 


- 

- 17 
- 6 
-11 


Sa n Diego 1 

B;)lHninrp 

Virginia 
Arkansas 


25.8 
43.1 


805 
980 
789 
481 




608 
832 
841 
383 


196 
148 
-52 

98 


DI I 

413 
249 
153 


591 
421 
308 
199 


-81 
- 8 
-59* 
-45** 




















Yes 


















Baltimore 
Virginia 
Arkansas 
No 


49.1 
65.3 
41.8 


458 
462 
159 




425 
376 
158 


33 
86* 
1 


400 
329 


402 
328 


- 2 

- 2 
1 


Baltimore 

VifffiniA 

Arkansas 


58.2 


487 
497 
143 




446 
459 
112 


40 
38 
32 


633 
432 


620 
495 

ICO 


13 
- 63** 
-104*** 


Ethnicity 


















Applicants 


















White 


















Baltimore 
Virginia 
Arkansas 
CookCounty^'^ 
Black 


Ol .D 

33.8 
41.8 
16.7 
21.8 


949 
922 
801 
403 
679 




821 
767 
663 
259 
709 


128* 

155 

138 

144 

-30 


357 
309 
128 
72 
353 


369 

i.J 1 o 

149 
82 
413 


-12 
- y 
-21 
-11 
-61* 


San Diego 1 
Baltimore*^ 
Virginia^ 
Arkansas^ 
Cook County^ 
Hispanic 


7{) 7 
66.2 
58.2 
83.3 
65.5 


895 
1,035 
832 
458 
741 




589 
855 
792 
358 
761 


306*** 
180** 
40 
100* 
-20 


532 
395 
235 
141 
502 


678 
412 
253 
170 
517 


-146*** 

-17 

-18 

-29* 

-15 


San Diego 1 
Cook County^ 


17.8 
12.6 


693 
458 




843 
608 


-150 
-150 


593 
510 


556 
450 


38 
60 
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TABLE B.9 (contiftued) 



Subgroup, Welfare 
StahiS/ and Program 


Percent 
of 

Sample^ 


Average Earnings 
Per Quarter^ 
Quarters 4 - Last 


Average AFDC 
Payments Per Quarter, 
Quarters 4 - Last 


Expert- 
mentals 


Controls Diffea^nce 


Expert- 
mentals 


Controls 


Difference 


Recipients 
















While 
















Baltimore 


25.1 


$420 


$438 


$18 


$579 


$575 


$4 


Virginia 


26.8 


490 


398 


92 


303 


305 


- 2 


Arkansas 


8.5 


337 


55 


282** 


207 


228 


-21 


Cook County^'^ 
Black 


14.3 


517 


322 


195*** 


572 


604 


-31 


Baltimore^ 


74.9 


490 


436 


55 


644 


638 


6 


Virginia 


73.2 


468 


408 


60 


451 


483 


-32* 


Arkansas*^ 


91.5 


132 


1.36 


- 4 


290 


3.54 


-64*** 


Cook County^ 


75.3 


322 






761 


771 


- 11 


Hispanic 
















Cook County^ 


10.4 


324 


265 


59 


730 


734 


- 4 


Labor Market 
















Applicants 
















Urban 
















Virginia 


78.7 


849 


769 


80 


195 


213 


- 18 


Arkansas 


64.8 


403 


30? 


100 


99 


126 


-27 


Rural 
















Virginia 


21.3 


707 


625 


82 


174 


198 


-24 


Arkansas 


35.2 




413 


120 


1 Mn 

10/ 


111 


- 24 


Recipients 
















Urban 
















Virginia 


/8.8 


521 


421 


100** 


411 


450 


- 39** 


Arkansas 


56.5 


211 


120 


91* 


250 


325 


- 75*** 


Rural 
















Virginia 


21.2 


299 


.346 


-47 


413 


.383 


.30 


Arkansas 


43.5 


76 


152 


-76 


326 


366 


-41 



SOURCE: Adapted from Friodlander, 1988b. 

NOTES: The impact estimates are unconditional, i.e., other subgioup characteristics are not con- 
trolled for. Not all subgroups were present in each program. The impacts are t>stimated for the fourth 
through last quarter of follow-up. 

^Percent of applicants and percent of recipients. 

^he definitions of "applicant" and "recipient" for Cook County are not stnctly comparable to those 
of the other programs. See the text of Frit»dlander, 1988b, for discussion. 

^For Baltimore, Virginia, and Arkansas, the category "black" includes a small numbcT of individ- 
uals in other non-white groups. In San Diego 1 and Cook County, "white" includes a small number 
of non-black, non-Hispanic, non-white persons. 

*Denotes statistical significance at the 10 percent level; ** at the 5 percent level; and *** at the 1 percent 
level. 
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Appendix C 

Supplemental Table 
for Chapter 5 



TABLE CI SUMMARY AND QUARTERLY IMPACTS OF THE MAINE 
ON-THE-JOB TRAINING PROGRAM ON AFDC ELIGIBLES 



Outcome and Fol!ow-Up PerioJ 



Experimental 
Group Mean 



Control 
Group Mean 



Difference 



Percentage 
Change 



Ever Employed, Quarters 2-1 1 


81.8% 


80.2% 


1.6 


2% 


Average Number of Quarters with 










Employment, Quarters 2- 1 1 


4.69 


4.21 


0.48 


11% 


Ever Employed 










Quarter of Random Assignment 


16.4% 


24.7% 


- 8.2** 


-33% 


Quarter 2 


23.5 


34.8 


-11.3** 


-32 


Quarter 3 


42.8 


39.3 


3.5 


9 








8,3 


19 


Quarter 5 


49.9 


41. ,1 


8.6* 


21 


Quarter 6 


47.9 


40.7 


7.2 


18 


vunFier / 




AC l\ 


5,4 


12 


Quarter 8 


50.2 


43,4 


6.9 


16 


Quarter 9 


5().6 


43.4 


7.1 


16 


Qua-ter 10 




39.7 


11.1** 


28 


Quartern 


50.4 


49.3 


1.1 


2 


Average Total Eirnings, 










Quarters 2-11 


$7,344 


$5,599 


$1,745** 


31'; 


Average Total Earnings 










Quarter of Random Assignment 


$71 


$109 


-$38 


- 35';!. 


Quarter 2 


173 


289 


-116** 


•4() 


Quarter 3 


535 


436 


99 


23 


Quarter 4 


687 


529 


158* 


3() 


Quarter 5 


716 


475 


241** 


51 


Quarter 6 


745 


572 


173* 


M) 


Quarter 7 


840 


601 


239** 


4i) 


Quarter 8 


882 


663 


219** 


33 


Quarter 9 


918 


669 


249** 


37 


Quarter 10 


916 


642 


274** 


43 


Quarter 11 


933 


724 


209* 


2<i 



konlimted) 
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TABLE CI (continued) 



Outcome and Follow-Up I'ericxi 


Hxperimental 
Grt)up Mean 


Contrt)! 
Griiup Mean 


Difference 


Percentage 
Change 


Ever ReaMved Any AFDC Payments. 










Quarters 2-11 




98.0^;^ 


0.3 


0% 


Average Number of Months Receiving 










1 O /.I 

Iv.ol 


19.19 


0.42 


2% 


fcver Received Any AFDC Payments 










Quarter of Random Assignment 




99.47, 


-0.7 


- 17f 


Quarter 2 




98.0 


-0.4 


0 


Quarter 3 


89.9 


89.8 


0.0 


0 


Quarter 4 


81.8 


85.1 


-3.3 


-4 


Quarter 5 


77.3 


77.1 


0,2 


0 


Quarter 6 


73.8 


71.4 


2,4 


3 


Quarter? 


70.1) 


68.7 




z 


Quarters 


64.4 


63.1 


1.3 


2 


Quarter 9 


62.8 


60.2 


25 


4 


Quarter 10 


58.9 


52.5 


6.4 


12 


Quartern 


55.8 


49.8 


6.0 


12 


Average Total AFDC Payments 
Received, Quarters 2*1 1 


$6,768 


$6,599 


$170 


3';i 



Average Total AFDC Payments 
Received 



Quarter of Random Assignment 


$924 


$941 


-$17 


Quarter 2 


918 


887 


31 


Qu^rte; 3 


835 


799 


36 


Qua/ter4 


742 


728 


14 


Quarters 


695 


687 


8 


Quarter 6 


681 


650 


32 


Quarter? 


637 


636 


0 


Quarters 


59h 


607 


-11 


Quarter 9 


578 


583 


-5 


Quarter 10 


562 


516 


45 


Quarter 11 


523 


506 


20 


Sample Si/e 


297 


147 





4 



303 
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TABLE CI (contwued) 



SOURCE: Adapted from Auspos, Cave, nnd Long, 1988. 

NOTES: Thcearningsand AFDC paymentsdata include zero values for sample members not employed and 
for sample members not receiving; welfare. Estimates are regression-adjusted using ordinary least squares, 
controllingforpre-randomassignmentcharacteristicsofsamplemembers. There may be some discrepancies 
in experimental-control differences bt»cause of rounding. 

For all outcomes, the quarter of random assignment refers to the calendar quarter in which random 
assignment occurred. Quarter 1, the quarter of random assignment, may contain somt earnings and AFDC 
paymentsfrom the period prior to r.mdomassignmenland is therefore excluded from all summary measures 
of follow-up. 

A two-tailed t-test wai applied to differences betwwn experimental and contrcl groups. Statistii 
significance levels are indicated as: • = lU percent; •* 5 percent; and = 1 percent. 



288 



References 



American Public Welfare Association. 1990. "Early State Experiences and Policy Issues in 
the Implementation of the JOBS Program: Briefing Taper for Human Service Admin- 
istrators." Washington, D.C.: American Public Welfare Association. 

Ashenfelter, Orley. 1987. 'The Case for EvaluaHng Training Programs with Randomized 
Triab." Ecotiomics of Education Review, 6(4): 333-338. 

Auspos, Patricia; Cave, George; Doolittle, Fred; and Hoerz, Gregory. 1989. Implementing 
jOBSTARTiA Demonstration for School Dropouts in the JTPA Sysiem. NewYork: MDRC. 

Auspos, Patricia; Cave, George; and Long, David. 1988. Maine: Fina' Report on the Training 
Opportunities in the Private Sector Program. New York: MDRC. 

Ball Joseph. 1984, West Virginia: Interim Findings on the Community Work Experience Dem- 
onstrations, New York: MDRC. 

Bane, Mary Jo; and Ellwood, David T. 1983. The Dynamics of Dependence: The Routes to 
Self -Sufficiency. Cambridge, Mass.: Urban Systems Research and Engineering, Inc. 

Bamow, Burt S. 1987. 'The Impact of CETA Programs on Earnings." journal of Human 
Resources, 22(2): 157-191. 

Bassi, Laurie J.; Simms, Margaret C; Burbridge, Lynn C; and Betsey, Charles L. 1984. 
Measuring the Effect of CETA on Youth and the Economically Disadvantaged. Final Report 
prepared for the U.S. Department of Labor. Washington, D.C.: Urban InsHtute. 

Bell, Stephen H.; Burstein, Nancy R.; and Orr, Larry L. 1987. Overvieu^ of EiHiluation Re- 
sults: Evaluationof the AWCHomemaker-Home Health Aide Demonstrations.Cambrid^e, 
Mass.: Abt Associates Inc. 

Bell, Stephen H.; Enns, John H.; and Orr, Larry L. 1986. 'The Effects of Job Training and 
Employment on the Earnings and Public Benefits of AFDC Recipients: The AFDC 
Homemaker-Home Health Aide Demonstrations." Draft. Paper presented at the 
Annual Research Conference of the Association for Public Policy Analysis and 
Management, Austin, Tetas. 

Bell, Stephen H.; and Fi'in, David J. Forthcoming. Ohio Transitions to Independence 
Demonstration: Program Impacts in the First Fiscal Year. Cambridge, Mass.: Abt 
Associates Inc. 

Bell, Stephen H.; Hamilton, William L.; and Burstein, Nancy R. 1989, Ohio Transitions to 
IndefK'ndence EiHiluation: Design of the Cost-Benefit Analysis, Cambridge, M»iss.: Abt 
Associates Inc. 

Bell, Stephen H.; and Orr, Larry L. 1988. "Screening (and Creaming?) Applicants to Job 
Training Program.s: The AFDC Homemaker-Home Health Aide Demonstrations." 
Paper presented at the Annual Research Conference of the Association for Public 
Policy Analysis and Management, Seattle, Washington. 

Beriin, Gordon; and Sum, Andrei'. 1988. Toioard a More Perfect Union: Basic Skills, Poor 
Families, and Our Economic Future. Ford Foundation Project on Social Welfare and the 
American Future, Occasional Paper No. 3. New York: Ford Foundation. 

Berman, Paul; and McLaughlin, Milbrey W. 1978. Federal Programs Supptjrting Educatuynal 
Cltange, Vol. Vlll: Implementing and Sustaining Innowtions. Santa Monica, C : Rand 
Corporation. 




289 



ERIC 



REFERENCES 



Betsey, Charles L.; Hollister, Robinson G.; and Papageorgiou, Mary R., eds. 1985, Youth 
Employment and Training Programs: The YEDPA Years. Washington, D.C.: N tiional 
Academy Press. 

Blau, D. M.; and Robins, P. K. 1986. "FerHlity, Employment, and Child Care Costs: A 
Dynamic Analysis." Paper presented at the Annual Meeting of the Population 
Association of America, San Francisco. 

Bloom, Howard; Orr, Larry; Doolittle, Fred; Hotz, Joseph; and Barnow, Burt. 1990. Design 
of the National JTPA Study. Washington, D.C.: Abt Associates Inc. and MDRC. 

Board of Directors, Manpower Demonstration Research Corporation. 1980. Summary and 
Findings of the National Supported Work Demonstration. New York: MDRC. 

Brooks-Gunn, J. 1989. "Opportunities for Change: Effects of Intervention Programs on 
Mothers and Children." Paper prepared for the Forum on Children and the Family 
Support Act, the National Forum on the Future of Children and Families, National 
Academy of Sciences, Washington, D.C. 

Brown, Randall; Burghardt, John; Cavin, Edward; Long, David; Mallar, Charles; Maynard, 
Rebecca; Metcalf, Charles; Thornton, Craig; and Whitebread, Christine. 1983. The 
Employment Oppintunities Pilot Project: Analysis of Program Impacts. Princeton, N.J.: 
Mathematica Policy Research, Inc. 

Burtless, Gary. 1989. "The Effect of Reform on Employment, Earnings, and Income." In 
Phoebe H. Cottingham and David T. Ellwood/ eds.. Welfare Policy for the 1990s. 
Cambridge, Ma^^s.: Harvard University Press. 

Burtless Gary; and Orr, Larry. Fall 1986. "Are Classical Experiments Needed for Man- 
pt)wer Policy?" Journal of Human Resources, 21: 606-639. 

Campbell, Frances A.; Breitmayer, Bonnie; and Ramey, Craig T. 1986. "Disadvantaged 
Single Teenage Mothers and Their Children: Consequences of Free Educational Day 
Care." Family Relations, 35(1): 63-68. 

Cave, George. 1989. "Subgroup Impacts of a Wage Subsidy Prog.-am; Randomized Trials 
of OJT for AFDC Recipients." Paper presented at the One Hundred and Second 
Annual Meeting of the American Economic Association, Atlanta, Georgia. 

Cella, Margot. 1987. Operational Costs of Demonsi ^tion Activities: Ewluation of the AFDC 
Homemaker-Home Health Aide Demonstrations. Cambridge, Mass.: Abt Associates Inc. 

Cherlin, Andrew. 1989. "Child Care and the Family Support Act: Policy Issues." Paper 
prepared for the Forum on Children and the Family Support Act, theNational Forum 
on the Future of Children and Families, National Academy of Sciences, Washington, 
D.C. 

Doolittle, ¥tl\\; and Traeger, Linda. 1990. Implementing the National JTPA Study. New Vn-k: 



Ellwood, David T. 1988. Poor Support: Powtyin the American Family. New York: Basic Biwks. 

Ellwood, David T. 1986. Targeting "Would-Bv" Long-Term Recipients of AFDC, Princeton, 
N.J.: Mathematica Policy Resecirch, Inc. 

Enns, John H.; Bell, Stephen H.; and Flanagan. Kathleen L. 1987. Trainee Employment and 
Earnings. Cambridge, Mass.: Abt Associates Inc. 

Family Support Act of 1988. October 13, 1988. 100th Cong., 2d sess. Public Law WASS. 
Field, T.; Widmayer, S.; Greenberg, R.; and Stoller, S. 1982. "Effects of Parent Training on 
Teenage Mothers and Their Infants." Pediatrics, 69: 703-707. 



MDRC. 



ERIC 




REFERENCES 



291 



Ford Foundation Project on Social Welfare and the American Future. 1989. The Common 
Good: Social Welfare and the Americm Future, Policy Recommendations of the Execu- 
tive Panel. New York: Ford Foundation. 

Freedman, Stephen; Bryantjan; and Cave, George. 1988. Neiv Jersey; Final Report on the 
Grant Diversion Project, New York: MDRC. 

Friedlander, Daniel. 1988a. "An Analysis of Extended Follow-U p for the Virginia Employ- 
ment Services Program." Unpublished internal document. New York: MDRC. 

Friedlander, Daniel. 1988b. Subj^roup Impacts and Performance Indicators for Selected VJelfare 
Employment Programs, New York: MDRC. 

Friedlander, Daniel. .987. Maryland: Supplemental Report on the Baltimore Options Program, 
New York: MDRC 

Friedlander, Daniel; Enrkson, Marjorie; Hamilton, Gayle; and Kno.\, Virginia. 1986. West 
Virginia: Final Report on the Community Work Experience Demonstrations. New York: 



Friedlander, Daniel; Freedman, Stephen; Hamilton, Gayle; and Quint, Janet. 1987. Illinois: 
Final Report on Job Search and Work Experience in Cook County, New York: MDRC. 

Friedlander, Daniel; and Goldman, Barbara. 1988. Employment and Welfare Impacts of the 
Arkansas WORK Program: A Three-Year Follow-Up Study in Tivo Counties, New York: 
MDRC. 

Friedlander, Daniel; and Gueron, Judith M. Forthcoming. "Are High-Cost Services More 
Effective Than Low-Cost Services? Evidence from Experimental Evaluations of 
Welfare-to-Work Programs." In Charles F. Manski and Irwin Garfinkel, eds.. Evalu- 
ating Welfare and Training Programs, Cambridge, Mass.: Harvard University Press. 

Friedlander, Daniel; Hoerz, Gregory; Long, David; and Quint, Janet. 1985a. Maryland: 
Final Report on the Employment Initiatives Evaluation, New York: MDRC. 

Friedlander, Daniel; Hoerz, Grpgory;Quint, Janet; and Riccio, James. \9S5b, Arkansas: Final 
Report on tht WORK Program in Two Counties. New York: MDRC. 

Garfinkel, Irwin; and McLanahan, Sara. 1986. Single Mothers and Their Children: A New 
American Dilemma, Washington, D.C.: Urban Institute. 

Goldman, BarbtV.a S. 1989. "Job Search Strategies for Women on Welfare." In Sharon L. 
Harlan and Ronnie J. Steinberg, eds.. Job Training for Women: The Promise and Limits of 
Public Policies, Philadelphia: Temple University Press. 

Goldman, Farbara. 1981. Impacts of the Immediate Job Search Assistance Experiment, New 
York: MDRC. 

Goldn^an, Barbara; Cavin, Edward; Erickson, Marjorie; Hamilton, Gayle; Hasselbring, 
Darlene; and Reynolds, Sandm. 1985a. Relationshtp Betiveen Earnings and Welfare 
Benefits for Working Recipients: Four Area Case Studies. New York: MDRC. 

Goldman, Barbara; Friedlander, Daniel; Gueron, Judith; and Long, David. 1985b. Findings 
from the San Diego Job Search and Work Experience Demonstration, New York: MDRC. 

Goldman, Barbara; Friedlander, Daniel; and Long, D^vid. 1986. California: Final Report on 
the San Diego Job Search and Work Ex^H-'riencc Demonstration. New York: MDRC. 

Goodwin, Leonard. 1977. "What Has Been Learned from the Work Incentive Program and 
Related Experiences: A Rev' of Research with Policy Implications." Report 
prepared for the Employment aiid Training Administration. Washington, D.C.: U.S. 
Department of l^bor. 



MDRC. 





292 



REFERENCES 



Gordon, Anne; and Burghardt, John. 1990. The Minority Female Single Parent Demonstration: 

Short-Term Economic Impacts. New York: Rockefeller Foundation. 
Gordon, Jesse E. 1978. "WIN Research: A Review of the Findings." In Charles Garvin, ed.. 

The Work Incentive Experience. Savage, Md.; Rowman and Littlefield. 
Gould-Stuart, Joanna, 1982, Welfare Women m a Group job Search Program: Their 

Experiences in the Louisville WIN Research Laboratory Project. New York; MDRC. 
Grossman, Jean Baldwin; Maynard, Rebecca; and Roberts, Judith. 1985. Reanalysis of the 

Effects of Selected Employment and Training Programs for Welfare Recipients. Princeton, 

N.J.: Mathematica Policy Research, Inc. 

Gueron, Judith M. 1990. "Work and Welfare: Lessons on Employment Programs." 
journal of Economic Perspectives, 4(1): 79-98. 

Gueron, Judith M. 1987. Reforming Welfare with Work. Ford Foundation Project on Social 
Welfare and the American Future, Occasional Paper No. 2. New York: Ford Founda- 
tion. 

Gueron, Judith M. 1985. 'The Demonstration of State Work/Welfare Initiatives." In R. F. 
Boruch and W. Wothke, eds.. Randomization and Field Experimentation. San Francisco: 
Jossey-Bass. 

Gueron, Judith M.; and Long, David A. 1990. "Welfare Employment Policy in the 1980s." 
!n Louis A. Ferman, Michele Hoy man, Joel Cutcher-Gershenfeld, and Ernest J. Sa voie, 
eds., Neiv Developments in Worker Training: A Legacy for the 1990s. Madison, Wis.: In- 
dustrial Relations Research Association. 

Gueron, Judith M.; and Nathan, Richard P. 1985. "The MDRC Work/Welfare Project: 
Objectives, Status, Significance." Policy Studies Revieiv, 4: 41 7-432. 

Hall, Arden R. 1980. "Education and Tra ning." In Philip K. Robins, RobertG. Spiegelman, 
Samuel Weiner, and Joseph G. Bell, eds., A Guaranteed Annual Income: Evidence from a 
Social Experiment. New York: Academic Press. 

Hamilton, Gayle. 1988. Interim Report on the Saturation Work Initiative Model in San Diego. 
New York: MDRC. 

Hamilton, Gayle; and Friedlander, Daniel. 1989. Final Report on the Saturation Work 
Initiative Model in San Diego. New York: MDRC. 

Hardy, J. B.; King, T. M.; Shipp, D. A.; and We>cher, D. W. 1981. "A Comprehensive 
Approach to Adolescent Pregnancy." In K. G. Scott, T. Field, and E. Robertson, eds.. 
Teenage Parents and Their Offspring. New York: Grune & Stratton. 

Heckman, James J. 1990. "Randomization and Social Policy Evaluation." Paper presented 
at a CDnference on "Evaluation Design for Welfare and Training Programs," spon- 
sored by the Institute for Research on Poverty of theUniversityofWisconsin-Madison 
and the Office of the Assistant Secretary for Planning and Evaluation of the U.S. 
Department of Health and Human Services, Airlie, Virginia. Collected papers from 

this conference will be published in Charles F.Manski and Irwin Garfinkel, eds., £w3/m- 
ating Welfare and Training Programs. Cambridge, Mass.: Harvard University Press. 
Forthcoming. 

Heckman, James J.; and Hotz, V. Joseph. 1989. "Choosing Among Alternative 
Konexperimental Methods for Estimating the Impact of Social Programs: The Case 
of Manpower Training." Journal of the American Statistical Association, 84: 862-880. 

Hershey, A.; and Nagatoshi, C. 1989. Implementing Services for Welfare Dependent Teenage 
Parents: Experiences in the DHHS/OFA Teenage Parent Demonstration. Prepared for the 
Department of Health and Human Services. Princeton, N.J.: Mathematica Policy 
Research, Inc. 



ERIC 

308 



REFERENCES 



293 



Hoerz, Gregory; and Hanson, Kaiia. 1986. "A Survey of Participants and Worksite Super- 
visors in the New York City Work Experience Program." New York: MDRC. 

Hogarth, Suzanne; Martin, Roger; and Nazar, Kathleen. 1989. Pennsylvania Saturation 
Work Program Impact Evaluation. Draft Report. Harrisburg, Pa.: Department of Pub- 
lic Welfare. 

Hollenbeck, Kevin; Hufnagle, John; and Kurth, Paula. 1990a. Implementation of the JOBS 
Program in Ohio: A Process Study. Second Annual Report. Columbus: Ohio State 
University, Center on Education and Training for Employment. 

Hollenbeck, Kevin; Hufnagle, John; and Kurth, Paula. 1990b. Implementation of the JOBS 
Program in Ohio: A Process Study. First Annual Report. Columbus: Ohio State 
University, Center on Education and Training for Employment. 

Hollister, Robinson G., Jr.; Kemper, Peter; and Maynard, Rebecca A., eds. 1984. The 
National Supported Work Demonstration. Madison, Wis.: University of Wisconsin 
Press. 

Interagency Low Income Opportunity Advisory Board, Executive Office of the President. 
1988. lip from Dependency, Supplement 4: Research Studiesand Bibliography, Washington, 
D.C.: U.S. Government Printing Office. 

Interagency Low Income Opportunity Advisory Board, Executive Office of the President, 
(no date). Special Terms and Conditions. Unpublished internal document. 

Job Training Longitudinal Survey Research Advisory i*anel. 1985. "Recommendations of 
the Job Training Longitudinal Survey Research Advisory Panel." Report prepared 
for the Office of Strategic Planning and Policy Development, Employment and 
Training Administration. Washington, D.C.: U.S. Department of Labor. 

Kemper, Peter; Long, David A.; and Thornton, Craig. 1984. "A Benefit-Cost Analysis of the 
Supported Work Experiment." In Robinson G. Hollister, Jr., Peter Kemper, and 
Rebecca A.MayT\aTd,eiis.,The National Supported Work Demonstration. Madison, Wis.: 
University of Wisconsin Press. 

Kemper, Peter; Long, David A.; and Thornton, Craig. 1981. The Supported Work Evaluation: 
Final Benefit-Cost Analysis. Princeton, N.J.: Mathematiai Policy Research, Inc. 

Ketron, Inc. 1980. The Long-Term Impact of WIN II: A Longitudinal Evaluation of the 
Employment Experiences of Participants in the Work Incentive Program. Wayne, 
Pa.: Ketron, Inc. 

Kirsch, Irwin S.; and Jungeblut, ^nn. 198b. Literacy: Profiles of America a Young Adulta. 
Princeton, N.J.: National Assessment of Educational Progress, Educational Testing 
Service. 

Lalonde, Robert; and Maynard, Rebecca. August 1987. "How Precise Are Evaluations of 
Employment and Training Programs: Evidence from a Field Experiment." Evaluation 
Reineiv, 11:428-451. 

Long, David; and Bloom, Dan. 1989. Design of the Project Learn Evaluation. Unpublished 
document prepared for the Ohio Department of Human Services. New York: 



Mallar, Charles; Kerachsky, Stuart; Thornton, Craig; and Long, David. 1982. Project Repiirt: 
Evaluation of the Economic Impact of the fob Corps Program, Third Folloiv-Up Report. 
Princeton, N.J.: Mathematica Policy Research, Inc. 

Malone, Margaret. 1986. Work and Welfare. Report prepared for the Subcommittee on Em- 
ployment and Productivity of the SenateCommittee on Labor and Human Resources 
and the Subcommittee on Social Security and Income Maintenance of the Senate 
Committee on Finance. 99th Cong., 2d sess. S. Prt. 99-177. 



MDRC 





294 



REFERENCES 



Manpower Demonstration Research Corporation. 1989, Unpublished internal documents. 

Manpower Demonstration Research Corporation. 1988. F mch Design for a Special Study 
of Case Mamgemeut in the Riverside County GAIN -rogram. Unpublished internal 
document. 

Martinson, Karin; and Riccio, James, 1989, GAIN: Child Care in o V^elfare Employment 
Initiative, New York; MDRC. 

Masters, Stanley. Fall 1981, 'The Effects of Supp ed Work on the Earnings and Transfer 
Payments of Its AFDC Target Group." Journal of Human Resources, 16(4): 600-636, 

Mathematica Policy Research, Inc, 1988. REACH V^elfare Initiative Program Evaluation: 
7ec)wical Proposal. Princeton, N,J.: Mathematica Policy Research, Inc, 

Maxfield, Myles, Jr. 199(* Planning Employment Services for the Disadimnta^^ed. New York: 
RiKkefellcr Foundation. 

Maynard, Rebecca; Maxfield, Myles; Grossman, Jean; and Long, David, 1986, "A Design 
of a Social Experimentation of Targeted Employment Services for AFDC Recipients," 
Paper prepared for the U,S. Department of Health and Human Services. Princeton, 
NJ.: Mathematica Policy Research, Inc. 

Mead, Lawrence M. 1990. "Should Workfare Be Mandatory? What Research Says " journal 
of Policy Analysis and Mana^^ement, 9(3): 4(X)-404, 

Mead, Lawrence M. 1986, Beyond Entitlement: The Social Obligations of Citizenship. New 
York: Free Press. 

Mincer, Jacob. 1989. "Human Capital and the Labor Market: A Review of Current Re- 
search." Educational Researcher, 18(4). 

Moffitt, Robert. 1990. "Evaluation Methixls for Program Entry Effects." Paper presented at 
a conference on "Evaluation Design for Welfare and Training Programs," spt)nsored 
by the Institute for Research on Poverty of the University of Wisconsin-Madison and 
the Office of the Assistant Secretary for Planning and Evaluation of the U.S. Depart- 
ment uf Health and Human Services, Air lie, Virginia. Collected papers from this con- 
ference will be published in Charles F. Manski and Irwin Garfinkel, eds., Ewluatin^ 
Welfare and Training Programs. Cambridge, Mass.: Harvard University Press. Forth- 
coming. 

New Jersey Department of Human Services. 1989. Child Care Plus: A Demonstration of En- 
hanced Child Care Options for Uno-lncome Families. Draft Report. Trenton: New Jersey 
Department of Human Services. 

Nightingale, Demetra Smith; and Burbridge, Lynn C. 1987. The Status of State Work-Welfare 
Programs in 1986: Implications fnr V^elfare Reform. Washington, D.C.: Urban histitute. 

Nightingale, Demetra Smith; Burbridge, Lynn C; Wissoker, Douglas; Bawden, Lee; 
St)nenstein, Freya L.; and Jeffries, Neal. 1989. Experiences of Massachusetts ET job 
Finders: Preliminary Findin^^s. Washington, D.C.: Urban Institute. 

North Carolina Department of Human Resources, (no date). Child Care Recycling Fund 
Demonstration Project: Pretest and Ewluation. Unpublished internal document. 

Olds, David L.; Belton, Jann; Cole, Robert; Foye, Howard; Helberg, June; Henderson, 
Charles R., Jr.; James, David; Kitzman, Harriet; Phelps, Charles; Sweeney, Patrick; 
and Tatelbaum, Robert, (no date). Nurse Home-Visitation for Mothers and Children: A 
Research Propi^sai Unpublished document. RtKhester, N.Y.: New Mothers Study, 
Department of Pediatrics, University of Rochester. 




REFERENCES 



295 



Olds, David L.; Henderson, Charles R., Jr.; Talelbaum, Robert; and Chamberlin, Robert. 

1988. "Improving the Life-Course Development of SiKially Disadvantaged Mothers: 
A Randomized Trial of Nurse Home Visitation." American lounial of Public Health, 
78(11): 1436-1445. 

O'Neill, June. 1990. Work and Welfare in Massachui>ettii: An Evaluation of the ET Program, 
Boston, Mass.: Pioneer Institute for Public Policy Research. 

O'Neill, June A.; Wolf, Douglas A.; Bassi, Laurie J.; and Hannan, Michael T. 1984. An 
Analysis of Time on Welfare, Final Report to the U.S. Department of Health and 
Human Services, Office of the Assistant Secretary for Planning and Evaluation. 
Washington, D.C.: Urban Institute. 

Orr, Larry L. 1987. Emluation of the AFDC Homemaker-Home Health Aide Demonstrations: 
Benefits and Cosfs. Cambridge, Mass.: Abt Associates Inc. 

Polit, Denise; and O'Hara, Joseph J. 1989. "Support Services." In Phwbe H. Cottingham 
and David T. Ellwood, ed§.. Welfare Policy for the 1990s, Cambridge, Mass.: Harvard 
University Press. 

Polit, Denise; Quint, Janet; and Rlccio, James. 1988. The Challenge of Serving Teenage 
Mothers: Lessons from Project Redirection, New York: MDRC. 

Porter, Kathryn H. 1990. Making JOBS Work: Wliat the Research Says Ahmt Effectiw Emphy- 
ment Programs for AFDC Recipients^ Washington, D.C.: Center on Budget and Policy 
Priorities. 

Puma, Michael; Werner, Alan; and Hojnncki, Marjorie. 1988. EcKiluation of the Fiwd Stamp 
Employment and Training Program: Refmt to Congress on Program Implementation, 
Cambridge, Mass.: Abt AssiKiates Inc. 

Quint, Janet C; and Guy, Cynthia A. 1989. Neio Chance: Lessons from the Pilot Phase. New 
York: MDRC. 

Quint, Janet; and Guy, Cynthia. 1986. Interim Findings from the WIN Demonstration Program 
in Cook County, New York: MDRC. 

Rein, Mildrtni. 1982. Dilemmas of Welfare Policy: Why Work Strategies Haven't Worked, New 
York: Praeger. 

Wccio, James; Cave, GtH)rgc, Freedman, Stephen; and Price, Marilyn. 1986. Virginia: Final 
Report on the Employment Sennces Progriwi, New York: MDRC. 

Riccio,James;Goldman, Barbara; Hamilton,Gayle; Martinson, Knrin;and Orenstein, Alan. 

1989. GAIN: pMrly Implementation Experiences and U'ssons, New York; MDRC. 

Shugoil Research; Battelle Human Affairs Research Centers; and Kearney /Centaur Divi- 
sion, A. T. Kearney, Inc. 1989. job Corjfs Computer- A'^sisted Instruction Pilot Project 
Euihrtion. Report prepared for the U.S. Department of Libor. Bethesda, Md.: Shugoll 
Research. 

SRI international. 1983. Final Kr/wrf on the Seattle'l)eni>^. Income Maintenance tlxphriment, 
Volume 1: Design and Results, Menio Park, Ca.; SRI International. 

Stolzenberg, R. M.; and Waite, L. J. 1984. "Lwal L\\xn Markers, Children and Libor h'orce 
Participation of Wives." Demography, 2\ : 137-170. 

Urban Institute. 1989. Ewluation Design for the Family lmieiH*ndence Program: Third Draft. 
Prepared for the Legislative Budget Committee, St»ite of Washington. Washington, 
D.C.: Urban Institute. 

U.S. Congression»il Budget Office. 1987. Work Related Programs for Welfare Recipuents, 
Washington, D.C.: U.S. Congressional Budget Office. 



3J1 



296 



REFERENCES 



VS. General AccounHng Office. 1987a. School Dropouts: Survey of Local Programs. Washing- 
ton, D.C.: U.S. General Accounting Office. 

U.S. General AccounHng Office. 1987b. Workatid Welfare: Currettt AFDC Work Programs attd 
Implications for Federal Policy. Washington, D.C.: U.S. General Accounting 



U.S. General Accounting Office. 1986. School Dropouts: The Extent and Nature of the Problem. 
Wa.shington, D.C.: U.S. Gen Tal Accounting Office. 

Venezky, Richard L.; Kaestle, Carl F.; and Sum, Andrew M. 1987. The Subtle Danger: Re- 
flections on the Literacy Abilities of America's Young Adults. Princeton, N.J.: Educational 
Testing Service. 

Wallace, John; and Long, David. 1987. GAIN: Planning and Early Implementation. New 
York: MDRC. 

Werner, Alan; and Nutt-Powell, Bonnie. 1988. Evaluation of the Comprehensit>e Employment 
Opportunity Support Centers, Vol. 1: Synthesis of Findings. Cambridge, Mass.: Abt 
Asisociates Inc. 

Wilson, Julie B.; and Ellwood, David T. 1989. "Welfare to Work Through the Eyes of 
Children: The Impact on Children of Parental Movement from AFDC to Employ- 
ment." Paper prepared for the Forum on Children and the Family Support Act, the 
National Fomm on the Future of Children and Families, National Academy of 
Sciences, Washington, D.C. 

Wolfhagen, Carl. 1983. job Search Strategics: Lessons from the Louisville WIN Laboratory. New 
York: MDRC. 

Zimmerman, David R.; Wichita John A.; Wills, Michael; Rynders, Paul; and Skidmore, 
Felicity. 1983. Final Reptfrt on job Search and Particiinition Requirements and Their En- 
forcement in the Employment OpfHJrtunities Pilot Project. Madison, Wis.: Mathematica 
Policy Research, Inc. 



Office. 




Subject Index 



Page numbers in italics refer to tables and figures. The symbol u refers to notes. The main 
table summarizing the completed evaluations appears as both Table 1.1 and, with minor 
additions, Table 4.6. The two tables are jointly cited in this index: 15-20 (16H-174). 



Abecedarian Project, 225, 119tt, 120, 232 

Activities. See Program activities 

ADC (Aid to Dependent Children), 52. See 

also AFDC 
Administrative activities and strategies, 
14, 43-44; impact, 184-186, 187-188, 241- 
243. See also Assessment; Case manage- 
ment; Counseling; Monitoring; Orienta- 
tion; Sanctioning 
Administrative records, as data source for 
impact studies, 82, 148«, 152h, 165h, 
202m 

Administrative structure, effect on im- 
pacts, 188 

AFDC (Aid to Families with Dependent 
Children): and evolution of welfare-to- 
work programs, 1,7-8, 52-60; percentage 
female, 10. See also Family Support Act 
of 1988; JOBS; Work Incentive (WIN) 
Program 

AFDC Homemaker-Home Health Aide 
Demonstrations, 29(273), 101, 107, 196- 
199, 297-295; activities, 29(773>,22, 202; 
costs, 29 (27.1), 34, 202, 256-257, 258; im- 
pacts, 29 (27.5), 27, 34, 101, 193, 196-199, 
297-29^^,213,214 

AFDC payments (dollars). See Welfare 
payments impacts 

AFDC population. See Characteristics of 
program populations 

AFDC receipt (percentagt«i of pet^ple still 
receiving welfare). See Welfare receipt 
impacts 

AFDC subgroups. See Subgroups 
AFDC-UP (Aid to Families with Depen- 
dent Children-Unemployed Parent), 54, 
67, 55 92, 94, 190; compared to AFDC, 
63; uffcct of jL',rant levels, 63; Family Sup- 
port Act provisions, and open questions 
on JOBS, 1,12, 34, 4546, 38, 160, 244, str 
rt/so Child support; impacts, 67, 86-87, 



165, 190; impacts of San Diego I and 
SWIM, 11, 12, 34-35, 46, 86-87, 160-162, 
161, 165; participation rates, 95, 99«, 
129, 134-136, 235, 160h: sanctioning, 
160h, 184; summary of impact findings, 
34-35, 45-46 

Aggregate impact. See Impacts, aggregate 

Aid to Dependent Children (ADC), 52. See 
aho AFDC 

Aid to Families with Dependent Chil- 
dren. 5^^ AFDC 

Aid Families with Dependent Chil- 
dren-Unemployed Parent, See AFIX- 
UP 

American Public Welfare Association, 
59« 

Applicants ant^ recipients (AFDC): im- 
pacts, see* SuDgroup impacts; impacts of 
SWIM, ^ee San Diego Saturation Work 
Initiative Model, applicants and recipi- 
ents. See also Target groups 

Arkansas WORK Program, 25 (168), 85, 
93-98; activities, 25 (168), 84, 85, 96, 97, 
2.30-232; costs, 25 (168), 85, 255, 256-257: 
goals, 93-94; impacts, 25 (168), 29, 34, 85, 
142, 146, 147, 149, 250, 252, 155-156, 187, 
262-264, 282-^284; participation rates, 
129«, 230-232, strflto Participation rates 

Assessment: administrative acUvity, 80; 
approaches, 242; flexible, 137; impacts, 
181, 184, 185; model, 44, 74, 75, 181; 
open questions on JOBS, 8, 1 2, 43-44, 57, 
59, 67, 241-243, 247-248; pre-JOBS, 43- 
44, 55; vs. fixed-sequence model, 180- 
181. Seeahv Case management 

Average impact. See Impacts, as averages 

Baltimore Options Program (Baltimore 
program), 27 (271), 85, 93-99; activities, 
27 (272), 22, 24, 31, 43, 74, 84, 85, 96, 98- 
99, 230-23 J, 137, 222; assessment in, 22, 



ERIC 



297 

3/3 



298 



SUBIECTINDEX 



43, 74, 127, 137; costs, 27 (271), 38, 85, 
99n, 256-257, 258, 259; education and 
training, 98-99, 99fi, see also Mixed- 
strategy programs; goals, 93-94; im- 
pacts, 11, 27 (272), 26, 28, 30, 34, 38, 40, 
41, 45, S5, 142, 146, 147, 250, 252, 152, 
255-256, 167, 219, 221, 265-267, 282-284; 
management, 98«, 176m; participation 
rates, 230-232, seen/so Participation rates 

Benefit-cost analysis, 32-35, 78, 162-164. 
See also Cost-effectiveness 

Broad -coverage programs: defined, 14, 80; 
described, 13-24, 79-100, 126-127; im- 
pacts, see Broad-coverage programs, 
impacts; in-progress, 88'9h 99-100; 
mandatory vs. voluntary, 81, see also 
Mandatory vs. voluntary programs/ 
"mandatorine.ss"; summary of findings, 
10-13, 24-49; summary tables, 25-27 
(168-171), 85-92; target groups, see uttder 
Target groups. Sec also individual pro- 
grams and topics 

Broad-coverage programs, impacts, 8, 25- 
27 (168-171), 25, 26-29, .36, 70-77, 75, 85-^ 
92, 140-162, 242-244, 146 147, 150 151, 
262''284; summary, 10-13, 25-27 (168- 
171), 26-32 , 34-35. See also AFDC-UI>; 
Applicants and recipients; Impacts; 
Long-term welfare receipt/recipients; 
Subgroup impacts 

Broad-coverage vs. selective-voluntary 
programs: client flow, 75 76; compara- 
bility, 10, 22-24, 74, 105; differences, 14, 
21-24, 66, 70-77, 75-76, 79-82, 84, um. 
105, 182, 2(4-207; effectiveness, 44-45, 
204-207, 217, 235-236, see aha Impacts; 
estimating impacts, 70-72; evaluation 
designs, 23, 75-76; overview, 13-24, 25- 
20 (168-174). Sir aho Low-cost vs. 
higher-cost servicers; Mandatory vs. voi- 
untary programs /"mandatoriness"; 
Mixed-strategy programs 
Broad-coverage voluntary programs. See 
Louisville WIN Laboratory Fxperi- 
nients; Massachusetts Employment and 
Training (HT) Choices Program 
Budget effects of welfare-to-work pro- 
grams. Sec Cost-effectiveness; Welfare 
payments impacts; Welfare receipt im- 
pacts 

Budget pressures oi\ states, 9, 21, 59. See 
also JOBS funding 

ERIC 3)4 



Budget trade-offs. Set' Funding; Policy 
trade-offs 

California. See Greater Avenues for Inde- 
pendence (GAIN) Program; San Diego 
programs 

"Capped entitlement," 59m 

Caseload characteristics. See Characteris- 
tics of program populations; Target 
groups 

Caseload turnover. See Sanctioning; Wel- 
fare dynamics; Welfare receipt impacts 

Case management, 39, 62, 64, 65, 67, 80, 
189; approaches, 12, 44, 57,81, 242; chal- 
lenges, 47; :mpacts, 1^4-185, 189; open 
questions on JOBS, 9, 12, 43-44, 57, 65, 
241-243, 247-248. See also Assessment; 
Counseling; Monitoring; Riverside 
Case Management Study (California); 
Sanctioning 

Center for Employment Training (CET). 
See Minority female Single Parent 
(MFSP) Demonstration 

CEOSC. See New York State Comprehen- 
sive Employment Opportunity Support 
Centers 

CET. See Center for Employment Train- 
ing 

CETA. See Comprehensive Employment 
and Training Act of 1973 

Characteristics of program ptipulations, 
62-63. See also JOBS target groups; Man- 
datory groups for welfare-to-work pro- 
grams; Subgroups; Target groups 

Chicago. See Cook County WIN Demon- 
stiation 

Child care, 24, 42, 48-49, 58, 64, 65, 66, 82, 
222, 1 14-120, 225-229, 230-234; FSA 
(non-JOBS) funding and guarantees, 
56, 65-66; impacts, 48, 202, 102: ir -pro- 
gram, 48, 56, 65, 231; on-site, 41; open 
questions on JOBS, 48-49, 248-249; ser- 
vices, 230-233; subsidies, 5, 48, 230, 248; 
transitional, see Transitional support 
services. See also Support services; Sup- 
port services tests 

Child poverty, as stimulus for reforms, 55 

Children: impacts, 53, 67, 67m, 82, 222, 
1 1 4; open questions on JOBS, 46-47, 245- 
246. See also Child care; Child support; 
Poverty reduction; Young mothers 

Child support, 1, 5, 53, 56m, 89, 90,117 



SUBIECT INDEX 



Child Support Assurance, 5 

Client choice of services, 43-44, 54, 55, 180- 

181. See also Assessment 
Client flow through programs, 71, 74, 75, 

76, 139 

Community college programs, 188; JOBS, 
177«;SWIM,132w 

Community services, 3, 23, 61, 63, 65, 188 

Community work experience programs 
(CWEP), 54, 165; as JOBS option, 56. Sec 
also West Virginia Community Work 
Experience Program; Work experience; 
"Workfare" 

Comparabilily of studies, 10, 22-24, 71 w, 
74, 94-95«, 105, 175«, 178-180, 204«, 258- 
260. See also Broad -cove rage vs. selec- 
tive-voluntary programs, differences 

"Compliance costs," 44, 45 

Components. Sec individual programs 
and services; Program activities; Selec- 
tive-voluntary programs 

Comprehensive Employment and Train- 
ing Act of 1973 (CETA), 176«, 193; stud- 
ies, 4«, 208 

Computer-assisted instruction. See Job 
Corps Computer-Assisted Instruction 
Evaluation 

Control groups, 13-14, 204-205«. Sec also 
Control group services; Impacts; Ran- 
dom assignment field experiments de- 
sign 

Control group services, 3, 13, 25, 69, 70«, 
83w, 96, 105«, 106«, 132«, 141«, 16^-174, 
175,188 

Cook County WIN Demonstration, 15 
(169K 85, 93-98; activities, 15 (169), 85, 
96, 97, IMK 188; costs, 15 (?69), 29, 37, 85. 
176«, 256-257, 260; goals, 93-94; impacts, 
15 (169K 29, 34, 85, U2, 153, 155-156, 165, 
268-269, 282-284; models, 93», 165«; 
participation rates, LW-IM, see also Par- 
ticipation rates; resource limitations, 28- 
29, 34, 37; sanctioning, 136«, 184 

Coordination of agencies, and JOBS. See 
JOBS, interagency ctwrdination 

Cost -effectiveness, 13, 41-42, 48, 78, 127, 
162-164, 167, 203, 2*^6; comparability of 
studies, 22-24, 45, 178-180, 258-260; low- 
cost vs. higher-cost services, 167, 176- 
180, 206-207; summary of findings, 32- 
39, 36. See also Costs; Funding; JOBS 
funding; Policy trade-offs 



299 

Costs. See Cost -effectiveness; Gross costs; 
Low-cost vs. higher-cost services; Net 
costs; Program costs. Sec also under indi- 
vidual programs 

Counseling, 8, 23, 226, 234-235. See also 
Case management; Support services 

Countable participation (JOBS). See JOBS, 
participation standards 

"Creaming," 154, 157 

Criminal behavior, impact of Job Corps 
and JOBSTART,in 

Critical open questions. See Open ques- 
tions on JOBS 

Crossovers, in experimental research, 70tt 

Cross-site comparisons, difficulties. See 
Broad-coverage vs. selective-voluntary 
programs; Comparability of studies 

Custodial parents, young. See JOBS edu- 
cation and training provisions/focus; 
JOBS target groups; Young custodial 
mothers' school requirement; Young 
mothers; Youth-oriented services 

CWEP. See Community work experience 
programs 

Data sources. See Administrative records 

Day care. b\ Child care 

Deferral, 128. See also Participation re- 
quirements 

Demonstration of State Work/ Welfare Ini- 
tiatives, x-xiii, 2-3. See also individual 
progr-jms 

Demonstrations. See individual programs 

Deregistration, 133, 136«, 138, 139. See also 
Sanctioning 

Deterrence. See Entry and exit effects; 
Sanctioning 

Differential impact: studies, 70, 70w, 85-92, 
108, m, 115-119, 164, UAtt, 180, 185, 189, 
235, 236; vs. net impact, 4, 70, 83, 236. See 
also Impacts; Net impact 

Direct costs. See Costs 

Disadvantaged, highly. See Long-term 
welfare receipt /recipients 

Disadvantagedness, level of in relation to 
impacts, 217. See also Subgroups 

Displaced workers, 78, 187«, 246 

Dollars, nominal vs. inflated, 175«, 194« 

Dropout prevention, 42-43, 216, 225-226. 
See also JOBS education and training 
provisions/focus; Mandatory educa- 
tion; Youth-oriented services 



315 



300 



SUBIECTINDEX 



Dropout recovery programs, 79 
Duration; program impacts, 10, 26, 27, 46- 
47, 77, 245-246; program requirements, 
96-97. See also Follow-up periods 

Early Access Program. See Illinois Early 

Access Program 
Earned income disregard, study of, 234 
Earned Income Tax Credit, 5 
Earnings distribution, 26, 28, 148 
Earnings gains vs. welfare savings, 7, 10, 
29-30, 31-32, 35, 36, 37, 149, 149«, 152; 
AFDC-UPs, 162; open questions on 
JOBS, 245-246. Seeaho Policy trade-offs 
Earnings impacts, 67, 82, 246; AFDC appli- 
cants and recipients, 159, 16(), 177, 186, 
189-191; AFDC-UPs, 161: broad-cover- 
age programs, 10-12, 15-17 (168-171), 26- 
32, 85-92, 140-154, 142-144, 146, 262-284; 
components of, 27; consistent and sus- 
tained gains, 26; distribution of gains, 26, 
28«, 148; education services, 108; selec- 
tive-voluntary programs, 10, 18-19(172- 
173K 26-27, 101.104, 195, 197-19^^, 2(H} 
201, 286-288; subgroups, nee Subgroup 
impacts; summary of findings, 10-12, 26- 
35; youth-oriented services. III, 228, Sev 
also Earnings gains vs. welfare savings; 

Impacts 
« 

ECCO. See Expanded Child Care Options 
(ECCO) Demonstration 

Economic conditions, 46, 47-48, 162, 187«; 
open questions on JOBS, 47-48, 246-247. 
See aho Labor market conditions 

Educational achievement and attainment, 
40-41, 46, 67, 82, :08. 218-220, 226; im- 
pacts, str umier Education and training 
services. See aho JOBS education and 
training provisions/ fiKUs 

Education and training services, 40-41, 65, 
98, lOMlO, 108, 148, 179, 188, 208-210,' 
212-214, 218-230; broad-coverage pro- 
grams, 28, 98, UO IM . 132; goals, 26, 40, 
218; impacts, 40-41, 67, 88, 101-104, 108. 
109^110, 11M13, 167, 189-191, ZZ7, 228, 
229; JOBS focus, see JOBS education and 
training provisions/focus; open ques- 
tions on JOBS, 10-11, 12, 33, 40-41, 48-49, 
179, 203, 218-219, 238-240; selective-vol- 
untary programs, V)l~104. 108; self-ini- 
tiated, see Self-initiated activities; vouch- 



ers, 220; youth-oriented services. 111- 
113. Srrr?/!?o JOBS education and training 
provisions/focus; Job skills training; 
Low-cost vs. higher-cost services; Man- 
datory education; Mixed-strategy pro- 
grams; Young custodial mothers' school 
requirement 

Education requirement, JOBS. See JOBS 
education and training provisions/ fiKUs 

Education research in relation to welfare- 
to-work programs, 40-41, 108, 109-110, 
218-7.19. See aho Education and training 
services 

Education system, and JOBS, 9, 57, 59, 65, 
177«. Sir also Education and training 
services; JOBS, interagency coordination 

Effectiveness of programs. See Impacts; 
Policy trade-offs 

Eligibility for programs. Soc Target groups 

Employability plan, JOBS, 57. See also As- 
sessment 

Employment and Training (ET) Choices 
Program. See Massachusetts Empir 
ment and Training (ET) Choices Prt 
gram 

Employment, as a goal of wel fare-to- work 
programs. See Program goals and phi- 
losophies 

Employment impacts, 10; AFDC appli- 
cants and recipients, 158, 159; AFDC- 
UPs, see AFDC-UP, impacts; ^road- 
coverage programs, 10-12, 26-29, ^5-92, 
140^154, 142 144, 147, 159, 262-281; edu- 
cation services, 108; selective-voluntary 
programs, 10, 26-27, 10hl04. 195, 197- 
198, 200-201. 286-288: subgroups, see 
Subgroup impacts; summary of find- 
ings, 10-12, 26-35; youth-oriented ser- 
vices, U1.228. See also Impacts 

Employment Opportunity Pilot Project 
(EOPP), H4«, 1.32«, 149f/ 

Employment rates. See Employment im- 
pacts 

Employment services. See individual pro- 
grams and services 

Employment Services Program (ESP). Sec 
Virginia Employment Services Program 

English as a Second Unguage (ESL), \37n. 
222. See also Education and training ser- 
vices 

Entry and exit effects, 63, 66, 7\,77'7l, 128, 



ERIC 



3 ' a 



SUBJECT INDEX 



183-184, 205«; open questions on JOBS, 
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Homemaker-Home Health Aide Demon- 
strations. See AFDC Homemaker-Home 
Health Aide Demonstrations 
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tion and training services 

Illinois, 89, 100, 116. 234. See also Cook 
County WIN Demonstration 

Illinois Career Advancement Demonstra- 
tion, 116, 234 

Illinois Early Access Program, 89, 100 

Impact measures, 37, 46, 67, 82, 167, 176- 
177, 180, 189, 205-207, 206h. See also Im- 
pacts, range of for current and future 
studies 
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71; AFDC applicants and recipients, 31, 
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Earnings gains vs. welfare savings; em- 
ployment, Mr Employment impacts; es- 
timating, 68-78, 167, 175-180; fact jrs af- 
fecting, see Impacts, factors affecting; 
fiKUs of book, 3; highest found in broad - 
coverage programs, 25; job search, 27, 
164-165, see also Broad -coverage pro- 
grams; JOBS target groups, see JOBS 
target groups; level of disadvantaged- 
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ness, 227, see also Subgroup impacts; 
maximizing, 12, 167, 175-180, 207, 215- 
2l6, see also Low-cost vs. higher-cost ser- 
vices, Policy trade-offs; measures, see 
Impact measures; mixed-strategy pro- 
grams, see Mixed-strategy programs; net 
vs. differential, 4, 70, 70«, 83, see also 
Differential impact. Net impact; open 
questions on JOBS, 39-49, 238-250; per 
experimental vs. per participant, 71, 
205«; on poverty, see Poverty reduction; 
quarterly, see Quarterly impacts; range 
of for current and future studies, 46, 82, 
245-246, see also Impact measures; selec- 
tive-\oluntary programs, see under Se- 
lective-voluntary programs; subgroup, 
see Subgroup impacts; summary of find- 
ings, 10-12, 26-35, 36 (across program 
types), see also Policy trade-offs; support 
services tests, 215-229; of systems, 71,81, 
see also Broad-coverage vs. selective-vol- 
untary programs; threshold resources 
nt^eded, 28-29, 34, 37, 177, 212; vs. out- 
comes, 68, 163, 214; wages, see Wages, 
impacts on; welfare receipt, see Welfare 
receipt impacts; welfare savings, see 
Welfare paymentii impacts. Welfare re- 
ceipt impacts; work experience, see 
Work experience; youth-oriented ser- 
vices, 222-223, 228, see also Youth-ori- 
ented services: zero values, 95, 141, 145. 
See also individual programs; Net im- 
pacts 

Impacts, factors affecting: overview, 60- 
67, 62; program components, 164-167, 
see also Low-cost vs. higher-cost services; 
program model and funding, 27, 164- 
191, see also Funding. See also Adminis- 
trative activities and >iiategies; Admin- 
istrative structure; Assessment; Case 
management; Community services; 
Control group services; Econon<ic con- 
ditions; Education and training services; 
Funding; Grant levels; Labor market 
conditions; Mandatory vs. voluntary 
programs/"mandatoriness"; Program 
scale; Random assignment, point of in 
relation to impacts; Sanctioning; Se- 
quencing of program components 

Impacts vs. outcomes, 68 

Implementation, 3. See also individual 
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programs and topics; JOBS implementa- 
tion; Participation rates 

Income effects of programs, 33, 152. See 
also Earnings gains vs. welfare savings; 
Poverty reduction 

Indirect costs. S^^ Costs 

Intake, 80 

Intensive services. See Higher-cost ser- 
vices 

Interagency coordination, JOBS. See JOBS, 

interagency coordination 
Interagency Low Income Opportunity 

Advisory Board, 62>i, 126« 
Interventions, factors affecting strength 

of, 60-67, 62 

Job clubs, 55-92, 93, 97, 181, 189; described, 

93n. See also Job search 
Job Corps, 42, 110, 222. See also jOBST ART 

Demonstration 
Job Corps Computer-Assisted Instruction 

Evaluation, 108, 109, 219, 224, 226, 227 
Job development and placement, 42, 222- 

223, 220, 222; as JOBS requirement, 56 
Job guarantees, 5 

Job Opportunities and Basic Skills Train- 
ing Program. Sfe JOBS 

Job quality; and assessment/choice 
model, 180-181; impacts on, 27, 36, 37, 
38, 167, 177, 203; as program objective, 
12, 37, 46, 245. Sec also Poverty reduction 

Job-readiness activities, as JOBS require- 
ment, 56 

Job-readiness of welfare recipients, 66, 
180, 189-190. See also "Creaming"; Long- 
term welfare receipt/recipients; Sub- 
group impacts; Subgroups; Subgroups 
and targeting 

JOBS (Job Opportunities and Basic Skills 
Training Program), 1, 55-60; administra- 
tion, 44, 47-48, 57-58; AFDC-UPs as PSA 
target group, see under AFDC-UP; as- 
sessment, see under Assessment; case 
management, see under Case manage- 
ment; child care, 58, 248-249, see also 
Child care. Transitional support ser- 
vices; education requirement, see JOBS 
education and training provisions/fo- 
cus; factors afftHTting, 52, 60^67, 6*2, see 
also Impacts, factors affecting; feasibil- 
ity, 47^8, 247-248; funding, see JOBS 



3 1 3 



304 



SUBJECT INDEX 



funding; goals and vision, 1, 8, 9, 37-38, 
39, 46, 58; implementation, see JOBS 
implementation; interagency coordina 
tion, 9, 47, 57, 59, 65, 177«, 208, 210; job 
development and placement, 56; and 
JTPA, 9, 57, 59, 65, 80, 177«, 208, 210; 
"learnfare" provision, 57, see also JOBS 
education and training provisions/fo- 
cus; long-term welfare recipients, see 
Long-term welfare receipt/recipients; 
mixed-strategy programs in relation to 
goals, 8, 11, 37-38, see also Mixed-strat- 
egy programs; mothers of preschool 
children as target group, see Mothers of 
preschool children; new "non-exempt" 
caseload, 9, 57; open questions, 39-49, 
238-250; options for administrators, see 
Options 1, 2, 3 for administrators; par- 
ticipation standards, 1, 24-26, 45, 46, 48, 
55, 57-58, 128-129, 136-138, 140; perfor- 
mance standards, 1, 8, 48, 248; policy 
trade-offs for administrators, see Policy 
trade-offs; potential effects, see JOBS 
potential impacts; requirements, 3^', 4^, 
55-59, see also JOBS education and train- 
ing provisions/focus, JOBS, participa- 
tion standards; sole, 47-48, 59, IOOh, 
246-247; selective- voluntary programs' 
relevance, 81-82, 100, 105, 193; services, 
22, 32, 39, 56-57; si :es' role in design- 
ing, 1, 7, 57, 59, see also JOB^" implemen- 
tation. Policy trade-offs; support ser- 
vices, 58, 248-249; target groups, see 
JOBS target groups; targeting and inten- 
sive services, 9, 12, 22, 32, 35, 38, 39, 57, 
67, 100, see also Options 1, 2, 3 for ad- 
ministrators; training requirement, 22, 
56, 65, 177«, 208, 210, see also AFDC-UP, 
JOBS education and training provi- 
sions/focus; transitional support ser- 
vices (FSA), see Transitional support 
services; voluntary participants, 9, 44- 
45, 58, 66, 100; young mothers as target 
group, see Long-term welfare receipt/ 
recipients, potential ^g-term recipi- 
ents. Mothers of preschool children. 
Young custodial mothers' school re- 
quirement 

Job search: broad -coverage programs' 
first activity, 21, 24-25, 27, 28, 85-92, 98, 
129-132, 230-232, 164, see also Broad- 
coverage programs, described, 97; im- 
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pacts, 27, 164-165, see also Broad-cover- 
age programs, impacts; goals, 26, 77, 
180; as JOBS option, 56; low-cost service, 
see Low-cost vs. higher-cost services; 
Option 1 administrators, see Options 

1, 2, 3 for administrators; policy trade- 
offs, 35, see also Policy trade-offs; par- 
ticipation rates, 230-131; vs. assess- 
ment/choice models, 180-181, see also 
Sequencing of program components. 
See uiso Broad -coverage programs; Job 
clubs 

Job search vs. human capital models. See 
Labor market attachment vs. human 
capital models 

Job search/work experience programs, 
165, 165«. See also Broa 1-coverage pro- 
grams; Fixed-sequence programs; Job 
search; Work experience 

JOBS education and training provisions/ 
focus, 1, 8, 9, 12, 34, 39, 40-41, 42, 45-46, 
55-57, 58, 80, 109, 1 10, 218-219, 225, 226, 
238-240; goals, 40-41, 58; open ques- 
tions, 39-42, 77, 238-240, 249; summa- 
rized, 55-57; young parents, 34, 42, 55, 
57, 109, 110, 216, 225, 226, 248-249. See 
also Education and training services; 
Mandatory education 

JOBS evaluation, 2, 3, 4, 40, 211, 250« 

JOBS funding: budget trade-offs, 64-65; 
"capped entitlement," 59m; federal, ix, 1, 
8, 9, 25, 56, 57, 59, 59«; and participation 
standards, 25, 129-130; potential effects 
on impacts, 7, 61, 64-65; resource alloca- 
tion strategies, 7, 35-39, 36, see also 
Mixed-strategy programs. Options 1, 

2, 3 for administrators; service effects, 
9, 37, 64; state funding pressures and 
design decisions, ix, 1-2, 7-9, 12, 21, 37, 
39, 42, 44, 56, 59, 64-65, 96, 179-180, see 
also Policy trade-offs; state "owner- 
ship," 12; by welfare and non-welfare 
agencies, see JOBS, interagency coordi- 
nation 

JOBS implementation, 1-2, 7-9, 45, 58-59, 
59«; open questions, 238-249. See also 
JOBS funding 

Job skills training, 12, 41, 56, 85-92, 202- 
104, 107; as JOBS requirement, 56. See 
also Education and training services; 
On-the-job training; individual pro- 
grams 
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JOBS potential impacts, 46-47, 203; open 
questions, 13, 238-249; factors affecting, 
52, 60-67, 61. See also Impacts, factors 
affecting 

JOBS target groups, 8, 9, 12, 55-58, 67, 216. 
See also AFDC-UP; Long-term welfare 
receipt/recipients; Mothers of pre- 
school children; Young fathers; Young 
mothers 

JOBSTART Demonstration, 42, 7.>i, 110, 
333,219,226,227,229 

Job Training Longitudinal Survey Re- 
search Advisory Panel, 4«, 69«, 208 

Job Training Partnership Act of 1982 
(JTPA), 9, 21, 48, 57, 59, 80, 80w, 100, 
176w, 17711, 193, 208, 210. See also Na- 
tional Job Training Partnership Act 
(JTPA) Study 

Johns Hopkins Center for School-Aged 
Mothers and Their Infants, 225, 235 

JTPA. Sefjjb Training Partnership Act of 
1982; National Job Training Partnership 
Act (JTPA) Study 

Kentucky. See Louisville WIN Laboratory 
Experiments 

Labor market attachment models and ser- 
vices. See job search; Work experience 

Labor market attachment vs. human capi- 
tal models, 26, 77. See also Education 
and training services, open questions 
on JOB?; Low-cost vs. higher-cost ser- 
vices 

Labor market conditions, 29, 41 , 47, 48, 60 
62, 62, 68, 78, 145, 165, 186-187; open 
questions on JOBS, 47-48, 247. See also 
Economic conditions 
Labor market impacts. Sec Earnings im- 
pacts; Employment impacts 
Labor market screen (up-front job S(?arch) 
vs. assessment/choice model, 180-181. 
See also Job search 
LEAP. See Ohio Learninv^, Earning, and 

Parenting Program 
"U-arnfare," 109, 110, 225, 226; defined, 
57. Sevfi/so Wisconsin Learnfare; Young 
custodial mothers' school requirement 
Learning, Earning, and Parenting Pro- 
gram. SVrOhio Learning, Earning, and 
Parenting (LEAP) Program 



Life skills assistance, 42, 226, 234-235. See 

also Support services 
Literacy impacts: GAIN evaluation, 109, 

189. See also Education and training 

services 

Longitudinal participation measures, 

128-129,132^,133,134,138,182 
Long-term welfare receipt /recipients, 
31-33, 40-43, 105, 177, 238-241; early 
JOBS experience, 59; human capital de- 
velopment approach, 1 1 , 40, 58, 59, 207, 
238-240, seealso Education and training 
services; impacts, 10, 27, 28, 31-33, 43, 
45, 154, 157-158, 175, 177, 183, 194-196, 
395, 212-213, 216-218, 241, see also 
National Supported Work Demon- 
stration, San Diego Saturation Work 
Initiative Model (applicants and recipi- 
ents); JOBS target group, 12, 32, see also 
JOBS target groups; open questions on 
JOBS, 40-43, 238-241; policy trade-offs, 
12, 35-39, 36, see also Options 1, 2, 3 for 
administrators. Policy tradeoffs; po- 
tential If ng-term recipients, 11, 12, 32, 
:M, 41-43, 58, 154, 179-180, 241, see also 
Mothers of preschool children. Youth- 
oriented services; research on charac- 
teristics of long-term recipients, 53, 60, 
62-63, 157-158, 216, 225; subgroup 
analysisandtargeting,31, 154. 255-256. 
157-158, 207, 207«, 216-218, see also 
Subgroup impacts 
Louisville WIN Laboratory Experiments 
(individual and group job search), 25 
(168), 16 (1691 29, 34, 84, 86, 92«,'93, 
95», 96«, 1 48«, 164-165, 1 75«, 21 2;/, 21 3- 
214, 256-257 
Low-cost services. See Job search; Job 
search/work experience programs; 
Work experience 
Low-cost vs. higher-cost services, 9, 11 
21, 27-28, 32, 34, 46, 192, 239-240; cost- 
effectiveness (summary), 34; factors 
apart from costs, 1 75; impacts, 12, 25-20 
(168'174l 26-39 (summary), 36, 47, 
167-180, 207, 237; length of follow-upl 
74, 77; mixed mtxlels, 235-237; open 
questions on JOBS, 39-49, 239-240. See 
also Broad-coverage vs. selective-vol- 
untary programs; Mixed-strategy pro- 
grams; Policy trade-offs 
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Macroeconomic effects, 77-78 

Maine On-the-job Training (OJT) Pro- 
gram, 18 (172), 101, 105-106, 199-203, 
200-201; activities, 18(172), 22, 101, 105- 
106; costs, 18 (172), 34, 101,256-257, 258; 
impacts, 18 (172), 30, 101, 194, 197, 197«, 
199-203, 200''201, 213, 286-288; targeting, 
22 

"Making work pay," 5-6. See also Poverty 
reduction 

Management information system (MIS), 
185-186 

Mandated participation, mechanisms of 
effects, 22-23,128 

Mandatory education, 42, 55, 107-114, 189, 
216, 218-226. See also Education and 
training services; Greater Avenues for 
Independence (GAIN) Program; JOBS 
education and training provisions /fo- 
cus; Low-cost vs. higher-cost services; 
Mixed-strategy programs; Young custo- 
dial mothers' school requirement 

Mandatory groups for welfare-to-work 
programs. See JOBS farget groups; Man- 
datory education; Mandatory vs. volun- 
tary programs/"mandatoriness"; Tar- 
get groups 

Mandatory programs. See Broad-coverage 
programs; Mandatory education; Man- 
datory vs. voluntary progriims/"man- 
datoriness"; Participation requirements; 
Selective and mandatory pmgrams 

Mandatory vs. voluntary programs/ 
"mandatoriness," 15-20 n68-174), 21, 28, 
4445, 6 1 , 73, 73m, 8 1 , 82, 83, 1 28, 1 36, 1 64, 
193«; degree of "mandatoriness," 44-45, 
66-67, 73n, 182-184; effects and open 
questions on JOBS, 12, 28, 44-45, 182-184, 
243-244. See also Broad-coverage vs. se- 
lective-voluntary programs 

Manpower Demonstration Research Cor- 
poration (MDRC), 2-3,186 

Maryland. See Baltimore Options Program 

Massachusetts Employment and Training 
(ET) Choices Program, 44, 54, 73, 84, 89. 
99, 181, 183, 183m, 185, 190; child care 
services, 232; non-experimental study, 
183n; participation, 138-140, 183; volun- 
tary and mandatory, I83n 

Matemal employment, effects, 46, 53, 120, 
245 
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Maternal support services. See Support 
services; Support services tests; Youth- 
oriented services 

Maximizing program effectiveness. See 
Impacts, maximizing; Policy trade-offs 

MDRC. See Manpower Demonstration Re- 
search Corporation 

Measures of program effectiveness. See 
Impact measures 

Medicaid receipt, 24, 33, 101, 106, 107, 163; 
open questions on JOBS, 48-49, 249; tran- 
sitional (FSA), 8, 39, 48-49, 56, 63, 67, 117, 
118, 120, 190-191; transitional (pre-FSA), 
117, lis, 120, 190-191. See also Support 
services 

Medical assistance. Sec Medicaid receipt; 
Support services 

Memphis Nurse Home Visitation Pro- 
gram, 117 

MFSP. See Minority Female Single Parent 
Demonstration 

Minimum wage increases, 5 

Minority Female Single Parent (MFSP) 
Demonstration, 41, 43, 102, 104ft, 107, 
208-209,213,219, 220-223 

MIS. See Management information system 

Mixed-strategy programs (Option 3 for ad- 
ministrators), 9, 11, 12, 21, 65, 235-237; 
impacts, 11, 28; JOBS impetus toward, 9, 
39; as policy trade-off, 12, 35-39, 36, see 
also Policy trade-offs; SWIM and Balti- 
more programs as examples of, 11. 21-22, 
28, 36, 37-38, 40, 98, 1 27, 1 32, 1 77-1 79, 206, 
248 

"Modeling effect," 53 

Models. See Program models 

Monitoring, 23, 61 , 67, 80, 1 29, 1 33, 1 53; im- 
pacts, 184-186. See also Case management 

Montgomery County, Ohio, Demonstra- 
tion, 117, 120, 190 

Mothers of preschrx)l children, 38, 55, 107, 
233; as JOBS target group, 9, 43, 55, 241, 
245, see also JOBS target groups; support 
services, see Support services. Support 
services tests. Youth-oriented services; 
under WIN, 93m. See also Long-term wel- 
fare receipt /recipients, potential long- 
term recipients; Youth-oriented services 

Multi-component programs, studies in 
progress, 99. See also Mixed-strategy 
programs; Selective-voluntary programs^ 
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NAEP. See National Assessment of Edu- 
cational Progress 

National Academy of Sciences, 68, 69 

National Assessment of Educational 
Progress (NAEP), 219« 

National Job Training Partnership Act 
(JTPA) Study, 102, 107, 209, 210, 219, 
223. See also Job Training Partnership 
Act of 1982 

National Supported Work Demonstra- 
tion, 106, 193-196, 195; activities, 19 
(173), 22, 100, 201, 106; comparability, 
23-24, \75n; costs, 19 (173), 24, 34, 107, 
104n, 175«, 256-257, 258, 260; focus on 
very disadvantaged, 12, 32; impacts, 19 
(173), 20m, 22, 27, 29, 32, 33, 34, 43, 72n, 
Wh 175«, 186, 193, 194, 295, 212-213; 
revenues, 20«, 24, 204m 

Negative income tax experiments, ix. See 
aha Seattle-Denver Income Mainte- 
nance Experiment (SIME/DIME) Man- 
power Experiment 

Net benefits. See Cost-effectiveness 

Net costs, 21, 25, 74, 83, 83m, 162-163, 252- 
260, 256-257; broad -coverage programs, 
25-27 (265-272), 85-92, 95-96, 252-260, 
2.56-257; defined, 162, 167, 252-253; edu- 
cation services, 20iJ; selective-voluntary 
programs, 18-19 (172-17^), 34, 201-204, 
204«, 252-260, 256-257; youth-oriented 
services, 222-223, 223m. SVt' (J/so Program 
costs 

Net impact, 4, 64, 69-70, 109, 120, 141; in- 
terpreting, 69-70; maximizing, 215-216; 
research design, 69-70, 109, 120, 141; 
studios, 85-92, 101-104, 108, 109, I]2- 
lU, 115-119, 120, 236; vs. differential 
impact, 4, 70, 83, 236; vs. outcome, 68. 
See aho Control group service- Differ- 
ential impact; Impacts; Random assign- 
ment field experiments design 

New Chance Demonstration, 42, 110, 222, 
226, 229-230 

New Jersey On-the-job Training (OJT) 
Program, 18 (172), 102, 105-106, 199-203, 
200-20/; activities, 2^ (272), 22, 202, 105- 
106; costs, 18 (172), 34, 202, 256-257, 258; 
impacts, 18 (172), M, 102, 185, 193, 197, 
197m, 199-203, 200-201; JOBS-relevance, 
22 

New Jersey Realizing Economic Achieve- 
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ment (REACH) Program, 44, 55, 84, 89, 
99,114,120,140, 181, 190; child care ser- 
vices, see Expanded Child Care Options 
(ECCO) Demonstration 

New York State Comprehensive Employ- 
ment Opportunity Support Centers 
(CEOSC), 203,107, 209,210 

Noncustodial parents, 1. See also Child 
support 

Non-experimental studies, 4, 4m, 69, 69m, 
183m 

Nonparticipants. See under Participation 
rates 

North Carolina Guaranteed Child Care 
Demonstration, 227, 120, 231-232 

Nurse Home Visitation Program: Preg- 
nancy/Early infancy, 235, 234-235 

OBRA. See Omnibus Budget Reconcilia- 
tion Act of 1981 

Occupational training. Sec Job skills train- 
ing 

Ohio Learning, Earning, and Parenting 
(LEAP) Program, 42, 110, 222, 216, 225. 
See aha Mandatory education 

Ohio transitional support services study, 
227, 120, 19J 

Ohio Transitions to Independence, 90, 99, 
140,185,190, 234 

OJT. See On-the-job training 

Omnibus Budget Reconciliation Act 
(OBRA) of 1981, 1, 5, 84, 84m, 149m 

On-the-job training (OJT), 11, 22, 27, 38, 
167, 203, 210; as JOBS option, 22, 56. See 
also Maine On-the-job Training (OJT) 
Program; New Jersey On-the-job Train- 
ing (OJT) Program 

Opt»n questions on JOBS, 10-11, 13, 39-49, 
238-250 

Options 1, 2, 3 for administrators, 9, 21-22, 
.^6, 37-39, 64-65. .Siv alao Low-cost vs. 
higher-cost servic(»s; Mixed-strategy 
programs; Policy trade-offs 

Orientation, 14,80, 138 

Outcomes, 64, 214; measures, aee Impact 
measures; vs. impacts, 68. See aho Im- 
pacts 

Parenting impacts, 67, 110, 1/2-222 
Parenting skills. See Youth-oriented ser- 
vices 
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Participation, definition used in this book, 
23 

Participation measures, 128-129. See also 
JOBS, participation standards; Partici- 
pation rates 

Participation rates, 15-20 (165-174), 24-26, 
64, 128-140, AFDC-UPs, see 

AFDC-UP; broad-coverage, 15-17 (168 
171), 130-131/ broad-coverage vs. selec- 
tive-voluntary programs, 15-20 (168- 
174), 71-72, 82; comparability, 129/1/ 
complex programs, 139, 185-186; cover- 
age in this book, 3; first vs. subsequent 
activities, 24-25, 129-132, 230-131, see 
also Job search; GAIN, 137-140, 139; 
highest longitudinal rate, 25; JOBS, see 
JOBS, participation standards; JOBS-rel- 
evance, 24-26, 136-140; monthly vs. 
longitudinal, 128-129, 132/1, 133-134; 
nonparticipation, 23, 24, 71, 75, 76, 133- 
134, 138-140, 139, 185, 205, 205h; 
patterns, 139/ selective-voluntary pro- 
grams, 18-19 (172-173), 71-72, 82; sum- 
mary of findings, 24-26, 44-45; tests of 
maximum feasible rates, 25, 84h, 94, 95, 
99/1, 133-137, 184, 206, see also Ptmnsyl- 
vania Saturation Work Program, San 
Diego Saturation Work Initiative 
Model, West Virginia Community 
Work Experience Program 

Participation requirements, 15-20 (168- 
174), 54, 84-^100, 128; AFDC-UPs, see 
AFLX^-UP; broad-coverage vs. selec- 
tive-voluntary programs, and effect on 
impacts, 21-23, enforcement, 66, 66/i, 67, 
97-98, 128, 206, see also Monitoring, 
Sanctioning; JOBS, ur JOBS, participa- 
tion Standards; ongoing, see Participa- 
tion rates, tests of maximum feasible 
rates. See also Mandatory vs. vciuntary 
programs/"mandatoriness"; Participa- 
tion rates 

Participation standards. Str JOBS, partici- 
pation standards; Participation require- 
ments 

Payoff of programs. See C\)st-effective- 
ness; Impacts; Policy tr.ide-offs 

Pennsylvania Saturation Work Program 
(I'SWP), 90,99, 140, 181. 185, 189-190 

Pennsylvania Work Registration Program 
(WRP),190 



Performance standards, 158. See also 
JOBS, performance standards 

Policy trade-offs, 3, 7, 9-12, 35-39 (sum- 
mary), 36, 178-180, 192, 206-207, 216- 
218, 239-240, 245; uncertainties about, 
38-39. See also Low-cost vs. higher-cost 
services; Mixed-strategy programs; Op- 
tions 1, 2, 3 for administrators 

Poverty reduction: complementary poli- 
cies aimed at, 5-6, 11, 33; and higher- 
cost programs, 177, 203; and JOBS 
focus, 46; less frequent measure in 
v^elfare-to-v^ork studies, see Impacts, 
range of for current and future studies; 
limitations of AFDC, 7, 52, 55; open 
questions on JOBS, 46-47, 245-246; 
summary of program results, 10-11, 12, 
33, 36,141,152-154 

Pre-employment training, as JOBS re- 
quirement, 56 

Pre-JOBS programs. See WIN Demonstra- 
tion Program; Work Incentive (WIN) 
Program 

Program activities, 15-20 (168-174), 67, 74, 
75, 97-100, 130-131/ broad-coverage 
programs, 15-17 (26^^-172), 85-92, 230- 
232, 235; education services, 108; selec- 
tive-voluntary programs, 18-19 (172- 
273), 202-104; self-initiated, in SWIM, 
235; support services tests, 115-119: 
youth-oriented services, 2 2 2-2 23. See 
also individual programs and topics 

Program components. See individual 
programs and topics; Program activi- 
ties; Selective-voluntary programs 

Program costs, 252-260, 256-257: compar- 
ing across programs, 22-24, 175/1, 258- 
260; cost measures, 252-255; direct, 
gross and net, 252; indirect, gross and 
net, 252-253. See also Cost-effectiveness; 
Funding; individual programs; Low- 
cost vs. higher-cost services; Net costs 

Program deregistration. See Deregistra- 
tion 

Program design. See Broad -cove rage vs. 

selective-voluntary programs; JOBS; 

Program models 
Program eligibility. See Target groups 
Program goals and philosophies, 1, 5, 26, 

52-55, 64, 65, 66, 77, 94, 180-181. See also 

Family Support Act of 1988, goals and 
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principles; JOBS, goals and vision; Policy 
trade-offs; Welfare-to-work programs, 
evolution 

Program groups. See Experimental groups 

Program impacts. See Impacts 

Program models, 62, 65, 93m; activities, 97- 
100; combining, 235-237; duration, 96-97; 
effects, 164-181; sequencing, see Se- 
quencing of program components. See 
ol$o individual programs 

Program scale, 21; open questions on 
JOBS, 38, 47-48, lOOw, 246-247; in relation 
to caseload turnover, see Welfare dy- 
namics; in relation to impacts, 69, 176;i, 
187, 246-247. See also Participation re- 
quirements; Study scale 

Program sequence. See Fixed-sequence 
programs; Sequencing of program com- 
ponents 

Program services. See individual programs 
and services; Program activities 

Program targeting. Str Target groups; Tar- 
geting 

Program types. See Broad-coverage vs. se- 
lective-voluntary programs; Program 
models 

Project Independence (Florida). See 

Florida Project Independence 
Project Redirection, 1 10, 1 11, 226-227, 228 
PSWP. See Pennsylvania Saturation Work 

Program 

Quarterly impacts, 155-156, 262-281; Ar- 
kansas and Baltimore compared, 146, 
147, 150, 151. See also Impacts 

Random assignment, point of in relation to 
impacts, 71, 72«, 74, 75-76, 77, 95, 14l)«, 
205. See also Random a.ssignment field 
experiments design 

Random assignment field experiments de- 
sign, 3-4, 4«, 13-14, 60, 71-72, 74, 75-76, 
77, 208; role of, 4, 68-70. See also Compa- 
rability of studies; Control group ser- 
vices; Net impact; Random assignment, 
point of in relation to impacts; Research 
designs 

REACH. See New Jersey Realizing Eco- 
nomic Achievement Program 

Reciprocal obiigations of welfare recipi- 
ents and govt.»mment, 1, 5, 53, 55 



Redirection. See Project Redirection 
Reform. See Welfare reform 
Research agenda. See Open questions on 
JOBS 

Research designs, 60, 77, 77n, 79, 83, 93w, 
109, 225, 226; broad -cove rage programs, 
85-92, 164w; comparability of studies, see 
Comparability of studies; education ser- 
vices, 108; selective-voluntary pro- 
grams, 101-104; support services tests, 
115-119; youth-oriented services. 111- 
113. See also Broad-coverage vs. selec- 
tive-voluntary programs, differences; 
individual program types; Non-experi- 
mental studies; Random assignment 
field experiments design 

Research samples in completed broad- 
coverage studies, 94«-95« 

Resource allocation strategies. See Options 
1, 2, 3 for administrators; Targeting 

Resources. See Funding; JOBS funding 

Riverside Case Management Study (Cali- 
fornia), 90, 99, 185, 189. See also Case 
management 

Rural programs, 29, 47-48, 187, 247. See also 
West Virginia Community Work Experi- 
ence Program 

Samples, 94«-95«. See also Target groups 
Sanctioning, 182-184; AFDC-UP, 184; 
broad-coverage mandatory programs, 
23, 54, 128, UO'131, 133, 153; effect on 
impacts, 44-45, 64, 66, 71, 175, 182, 183- 
184, 205«, 243, 246; programs for teenag- 
ers, 225; rates, 136«, 184; selective and 
mandatory programs, 73-74; SWIM, 11, 
28, 45, 134, 136«, 182, 184, 206. See also 
Mandatory vs. voluntary programs/ 
"mandatoriness"; Participation require- 
ments 

San Diego Employment Preparation Pro- 
gram/Experimental Work Experience 
Program (EPP/EWFP) (San Diego I), 17 
(170), 86, 93-98, 130131, 255, 256-2.57; 
AFDC-UP impacts, 34-35, 160-162, 161; 
goals, 93-94; impacts, 17(170), 34-35, 86, 
142, 155-156, 186, 270-271, 282-284; 
models, 93«; participation rates, 130-131, 
see also [Participation rates 

San Diego Saturation Work Initiative 
Model (SWIM), 17 (171), 28, 87, 93-98; 
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activities, 11, 17 (171), 11, 24-26, S7, 130- 
131, 222-223; AFDC-UPs, 11, 34-35, 46, 
S7, 161, 162; applicants and recipients 
(AFDC), 11, 28, 31-32, 38, 45, 157-160, 
159, 177, 182, 205-206, 212; benefit-cost 
ratio, 33; child care, 232-233; control 
group services, 96, 132fi, 141 ri, 171, 188; 
costs, 17 (171), 33, 37, 87, 96, 253-255, 
256-257, 259, 260; earnings impacts, 11, 
17(171), 28, 31, 45, 87, 143, 145, 159, 161, 
205-206, 272; education and training, 22, 
24-25, 40, 132, 222-223, see also Mixed- 
strategy programs; employment im- 
pacts, 45, 87, 141 159, 161, 272; enforce- 
ment and sanctioning, 11, 28, 45, 134, 
136«, 182, 184, 206; fixed sequence, 22, 
74, 75; funding, 95, 134; participation 
rates,24-25,129w,13fM3M33-134,133ri, 
135, 136-137, 182; pt)SsibU.» factors behind 
impacts, 28, 31-32, 206, 222-223; rel- 
evance to JOBS, 11, 25-26, 127, 136-137, 
see aho Mixed-strategy programs; 
scheduled hours, 137n; test of maximum 
feasible participation rates, 25, 94, 95, 
99fi, 133-137, 184, 206; welfare payments 
impacts, 17 (171), 30, 31^32, 35, 45, ti7, 
14.3, 159, 161, 273; welfare receipt im- 
pacts, 29, 31-32,^^7, 143, 149, 159, lbh273 
Savings. See Welfare savings 
Scale. See Program scale; Study scale 
School attendance incentives. See Ohio 
Learning, Earning, and Parenting 
(LEAP) Program 
School requirement in JOBS. See JOBS 
education and training provisions/ fo- 
cus; Mandatory education 
Scope of this book, 2-4, 79 
Seattle-Denver Income Maintenance Ex- 
periment (SIME/DIME) Manpower Ex- 
periment, m 1(19, 219, 220 
Selection and screening, 21, 22, 43. See also 
Selective and mandatory programs; Se- 
lective-voluntary programs 
Selective and mandatory programs, 73-74 
Selective-voluntary programs, 18-19 (172- 
m), 11, 100-110, l()l"li)4, 192-210; ac- 
tivities, 1819 (172-173), 38, 10M04, 192- 
193; client flow, 76; cost-effectiveness, 
33-35, 178; costs, 18-19 (172-173), lOV 
104, 175m, 197-198, 2^6-257: defined, 14, 
21, 80, 81, 82, 84; education and training 
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Participation rates; support services 
tests, 114-120, 115-119, 234-236; target 
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oriented services, 110-114, 111-113, 
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voluntary programs; Broad-coverage 
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voluntary programs/"mandatoriness" 
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erage programs, 188; GAIN, 139; as 
JOBS option, 56; SWIM, 132, 135 

Self-sufficiency, as a goal of welfare-to- 
work programs, 1. See also Welfare 
reform 

Sequencing of program components, 31, 
67, 74, 75, 83, 97-100, 130-131, 164, 180- 
181; open questions on JOBS, 241-243. 
See aho Client flow through programs; 
Fixed-sequence programs 

Service delivery systems, 14, 59, 72, 80, 81, 
127, 238. See aho Broad-coverage pro- 
grams; JOBS; Job Training Partnership 
Act of 1982; Work Incentive (WIN) Pro- 
gram 

Services. See individual programs and 
services; Program activities 

SIME/DIMH. See SeattL-Denver Income 
Maintenance Experiment 

Single parents, as welfare recipients. See 
Mothers of preseh(X)l children; Welfare 
recipients; Young custodial mothers' 
school requirement; Young mothers 

Social contract. See Reciprocal obligations 
of welfare recipients and government 

Social Security Act of 1935, 52, 55 

Standard of living, impacts on. See Pov- 
erty reduction 

Start dates of studies, 83; broad-coverage, 
85-92; education, 108; selective-volun- 
tary, 101-104; support services tests, 
115-118; youth-oriented, 111-113 

State commitment, 12, 49 

States, and JOBS. See JOBS; JOBS funding; 
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JOBS implementation; Policy trade-offs 
State welfare-to-work programs, 8. Scealso 

Welfare-to-work programs 
State Work/Welfare Initiatives, Demon- 
stration, 2-3 
Studies of welfare-to-work programs. Sec 
Evaluations of welfare-to-work pro- 
grams 

Study scale, 69m, 83; broad-coverage, 85- 
92, 94-95; education, 108; JOBS, 47-48; 
selective-voluntary, lOI-HM; support 
services tests, 115-119; youth-oriented, 
III-II3. See also Participation require- 
ments; Program scale 

Subgroup impacts, 10, 13, 30-32, 67, 141, 
154-160, 155-156, 159, 190, 194, 204, 211- 
218, 282-284, Seeaho AFDC-UP, impacts; 
Long-term welfare receipt/recipients, 
impacts 
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and targeting; Target groups 
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administrators; Target groups; Target- 
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Subsidized child care. See Child care 

Subsidized employment, 1 1 , 22, 24, 27, 29, 
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W :k e::perience 

Supported Work Demonstration. See Na- 
tional Supported Work Demonstration 

Support services, 64, 67, 81 , 107, 230; child 
care, see Child care; counseling, 8, 23, 
226; life skills assistance, 42, 226, 234- 
235; Medicaid, see Medicaid receipt; 
open questions on JOBS, 248-249; transi- 
tional, see Transitional support services; 
transportation assistance, 58, 234. See 
also Support services tests 

Support services tests, 82, 114-120, 115- 
119, 230-235. See also Support services 

SWIM. See San Diego Saturation Work Ini- 
tiative Model 

Systems. See Service delivery systems 

Target groups, 54, 73m, 83, 94-95m, 127; 
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mothers' school requirement; Young 
mothers 

Teenage Parent Demonstration, 42, 110, 
112,216, 225, 226 

Teenage parents. See Young custodial 
mothers' school requirement; Young fa- 
thers; Young mothers 

Teenage Pregnancy Intervention Program, 
116, 235 

Texas Transitional Child Care and Medic- 
aid Study, lis, 120, 232, 233 
Trade-offs. See Policy trade-offs 
Training. See Education and training ser- 
vices; Job skills training; On-the-job 
training. See also individual programs, 
activities 

Transfer payments. See Food Stamp re- 
ceipt; Medicaid receipt 

Transitional support services, 230-234; ef- 
fect on savings, 39; FSA, 8, 39, 46, 48-49, 
56, 63, 67, 114-120, 116-115, 190-191; 
open questions on JOBS, 48-49, 248-249; 
pre-FSA,48, 117, 11^^, 120, 190 191 

Transitions to Independence (Ohio). Sec 
Ohio Transitions to Independence 

Transportation assistance, 58, 234. See also 
Support .services 

Two-parent families. See AFDC-UP 

Unit costs of programs, 10i)M 
U.S. Congressional Budget Offii e, 54, 54m, 
126m 

U.S. Department of Health ana Human 
Services (HHS), x, xii, 2, 42, 58, 107, 226 
U.S. General Accounting Office, 54, 225 
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255, 256-257, 260; goals, 93-94; impacts. 
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fare receipt/recipients; Welfare reform 

Welfare dynamics, 3, 8, 13, 24, 60-64, 62, 
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Welfare receipt, long-term. See Long-term 
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costs, see Benefit-cost analysis. Cost-ef- 
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teristics of program populations; Long- 



term welfare receipt/recipients; Suh- 
group impacts; Subgroups 
Welfare reform: goals, see Program goals 
and philosophies; history, 5-6, 7-8, 49, 
52-59. See also Family Support Act of 
1988; JOBS; Work Incentive (WIN) Pro- 
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role of longer-term recipients, 31; sum- 
mary of findings, 10, 11, 29-35. See also 
Welfare payments impacts; Welfare re- 
ceipt impacts 

Welfare savings vs. earnings gains. See 
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"Above all others, Judy Gueron cind her colleAgue« at MDRC did the research thai 
led the Congress to pass the Family Support Act two years ago. As a result, we 
now have a historic opportunity to help welfare recipients become self-sufficient. 
But for that to happen, we must learn the lessons contained in Front Wclfmvto Work, 
and make sure they are reflected in the retorms being implemented across the 
nation." - Si:nator Danu:l Patrick Moymman 



"A truly exceptional achievement. This is the definitive book on welfare-to-work 
programs, it represents a triumph of reason and research in an arena svAimped 
by anecdote and emotion. MDRC's studies have dominated the discussion about 
welfare reform because they are universally accepted as careful, thoughtful, and 
unbiased. Anyone who cares about welfare reform - academics and administra- 
tors, politicians and the press, policy analysts and the pubhc - must read this 
book." - David T. Hi i \v(k>i), Professor of Public Policy, John F. Kennedy School of 
Government, Harvard University 



"Required reading for anyone involved in efforts to boost employment among 
welfare recipients. A thorough review of what we know - and the large amount 
wehciveyet to learn - about what works effectively. And a good antidote for ihose 
who tend to overstate the impacts that welfare-to-work programs, by themselves, 
can have in reducing poverty " - Rohi ui C^ri i nsti in. Executive Director, Center 
on Budget and Policy Priorities 



"Required reading for every administrator responsible for implementing JOBS, 
one of the most anibitious and complex social programs of the last few decades. 
Clearlyand concisely, this book illuminates the critical choices administrators face 
about whom to serve, what the desired outcomes are, and how to allocate 
resources." - Ji i \\ 1. Loim /, General Manager, Department of Social Services, City 
and County of San iTancisco 



"/>(im Welfare /;> Work is the 'Bible' on the MDRC* studies of welfare employment 
programs, which comprise most of what we know abor.t how to move welfare 
recipients toward work. This book is a 'must' for aryone interested in these 
initiatives, which are at the cutting edge r-\ social policy today." Lauri \( i M. 
Ml Ai), Associate Professor, Department of Politics, New York University 
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